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Abstract of EP1 047269 

The present invention aims to provide a 
broadcasting system based on storage (204,212) 
in consumer platforms wherein a broadcasting 
station side (100) controls the playback and 
viewing of images and voice stored in a receiving 
side (200) so to make it possible to perform the 
broadcasting service in various forms, and the 
broadcast transmitting apparatus (100) of the 
invention multiplexes (103) AV data and provision 
information for designating AV data, which the 
information provider intends to replay and view in 
accordance with the display of the AV data, and 
transmits it. Then, a broadcast receiving 
apparatus (200) makes it possible to replay and 
view only the AV designated by provision 
information corresponding to the AV data 
presented by a presentation information selecting 
means when outputting the received AV data and 
displaying it. The information provider transmits 
information, which the information provider of the 
broadcasting station side has created 
intentionally, when the information provider 
intends, and a viewer can receive information as 
the information provider intends, and view a 
portion or the entirety of the program broadcast 
so far based on the information. 
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STORAGE TYPE BROADCASTING SYSTEM, BROADCAST TRANSMITTER, AND 
BROADCAST RECEIVER 



Claims of corresponding document: EP1 047269 Translate this text 



1 . A broadcasting system based on storage in consumer platforms comprising a broadcast transmitting 
apparatus for transmitting AV data including an image of a program and sound and a broadcast receiving 
apparatus having storing means for storing received signals, wherein the broadcast transmitting apparatus 
multiplexes AV data and provision Information for designating AV data, which an information provider 
intends for replay and viewing in accordance with the display of the AV data, and transmits it, and the 
broadcast receiving apparatus makes it possible to replay and view only the AV data designated by the 
provision information corresponding to the AV date when displaying the received AV data. 

2. A broadcasting system based on storage in consumer platforms according to claim 1 , wherein the 
broadcast receiving apparatus generates presentation information, which makes it possible to select the 
playback and viewing of the AV data stored to correspond to the provision information, and stores it. 

3. A broadcasting system based on storage in consumer platforms according to claim 1 or 2, further 
comprising an AV data providing apparatus for storing ali AV data transmitted from the broadcast 
transmitting apparatus, wherein the broadcast receiving apparatus obtains the AV data from the AV data 
providing apparatus when there is no AV data that a user wishes to replay and view in the storing means ol 
the broadcast receiving apparatus. 

4. A broadcast transmitting apparatus for use in a broadcasting system based on storage in consumer 
platforms according to claim 1 , 2 or 3, the broadcast transmitting apparatus comprising: 

AV material storing means for storing AV data; 

AV material selecting means for selecting AV data from the AV material storing means- 
provision information storing means for storing the provision information; 

provision information selecting means for selecting provision information from the provision information 
stonng means; 

multiplexing means for multiplexing the AV data selected by the AV material selecting means and the 
provision information selected by the provision information selecting means to generate a multiplexed 
signal; and 

transmitting means for converting the multiplexed signal to a broadcast signal in accordance with a 
transmission rule so as to transmit it. 



5. A broadcast transmitting apparatus according to claim 4, wherein the provision information is composed 
of provision elements systemized in the form of a hierarchical structure, and the provision information 
selecting means selects a portion or the entirety of the provision elements. 

6. A broadcast transmitting apparatus according to claim 4 or 5, wherein the provision information is linked 
to the AV data designated by said provision information. 

7. A broadcasting transmitting apparatus according to claim 6, wherein information of the linked AV data is 
desenbed in the provision element. 

8. A broadcast transmitting apparatus according to claim 6 or 7, wherein the linked AV data is updated with 

a arise nf time r 



9. A broadcast transmitting apparatus according to any one of claims 4 to 8, wherein the provision 
information enabling information for making a portion or the entirety of presentation information, which has 
been stored in the broadcast receiving apparatus and which has been linked to AV data, available. 

10. A broadcast transmitting apparatus according to any one of claims 4 to 9, wherein a playback and 
viewing range of the AV data, which the information provider intends, is specified by cutting information 
and the provision information is linked to the cutting information. 

1 1 . A broadcast transmitting apparatus according to claim 1 0, wherein a presenting method after storing thi 
presentation information in the broadcast receiving apparatus is designated in the provision information. 
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12. A broadcast receiving apparatus for use in a broadcasting system based on storage in consumer 
platforms according to claim 1, 2 or 3, the broadcast receiving apparatus comprising: 

receiving means for receiving a broadcast signal; 

separating means for separating data received by the receiving means into AV data and the provision 
information; 

AV data storage processing means for performing storage processing of the AV data; 

AV data storing means for storing AV data subjected to storage processing by the AV data storage 

processing means; 

AV data selecting means for selecting necessary AV data from the AV data storing means; 

AV data output controlling means for determining AV data to be externally output by selecting either AV 

data from the separating means or AV data from the AV data selecting means; 

presentation information storage processing means for converting the provision information separated by 

the separating means to the presentation information; 

presentation information storing means for storing the presentation information; 

presentation information selecting means for selecting the presentation information stored in the 

presentation information storing means to provide an instruction of selecting AV data to the AV data 

selecting means based on the selected presentation information; and 

presentation information externally outputting means for externally outputting the presentation information 
from the presentation information selecting means. 



13. A broadcast receiving apparatus according to claim 12, wherein AV data received in real time is 
separated by the separating means to be output to an external device, and the AV data is stored in the AV 
data storing means, and the presentation information to be externally output is generated based on the 
provision information received in real time, and when any presentation information is selected therefrom 
corresponding data of the stored AV data is replayed. 

14. A broadcast receiving apparatus according to claim 12 or 13, wherein when the presentation 
information storing means stores the presentation information in advance and enabling information is 
transmitted from the broadcast transmitting apparatus, the presentation information selecting means select! 
presentation information, which has been made available by the enabling information, from the presentatior 
information stored in the presentation information storing means. 

15. A broadcast receiving apparatus according to claim 12, 13 or 14, wherein the presentation information 
stonng means stores cutting information that specifies a playback and viewing range of AV data transmittec 
from the broadcast transmitting apparatus, and the presentation information selecting means provides the 
instruction of selecting AV data to the AV data selecting means by use of the presentation information and 
the cutting information. 

16. A broadcast receiving apparatus according to claim 12, 13, 14 or 15, wherein the way of selection of 
presentation information by the presentation information selecting means is limited based on a rule set by a 
user or an output history of AV data output from the AV data output controlling means 
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STORAGE TYPE BROADCASTING SYSTEM, BROADCAST TRANSMITTER, AND 
BROADCAST RECEIVER 

Description of corresponding document: 
EP1 047269 

[0001] The present invention relates to a broadcasting system based on storage in consumer platforms, 
wherein a broadcasting station side transmits a program and information of the program, a receiving 
apparatus stores them to present them to a viewer in various kinds of service forms, and relates to the 
transmitting apparatus and the receiving apparatus, and particularly characterized in that the viewer can 
view stored images and voice associated with the scene of the program by the broadcasting station as 
viewing the program. 

[0002] In the digital broadcasting, there has been conventionally made the study and development of the a 
broadcasting system based on storage in consumer platforms wherein a storage medium is placed in a 
receiving apparatus such as a television and the content of a program and information accompanying 
therewith are stored, and displayed in various kinds of service forms. ° 

[0003] Japanese Patent Laid-Open No. 9-135391 discloses a broadcasting system wherein a transmitting 
side transmits section information that designates a highlight portion, the receiving apparatus stores only 
the portion, and the viewer of the receiving side can replay and view the stored highlight scene and view it 
whenever necessary. 

[0004] Japanese Patent Laid-Open No. 10-304321 discloses a broadcasting system wherein the 
transmitting side transmits additional information of a program and the receiving side stores the additional 
information 

[0005] However, in the conventional a broadcasting system based on storage in consumer platforms, since 
the selection from the stored highlight scenes and additional information depends on the viewers it is 
difficult for the viewers to search for information that they wish in a case where a large amount of' 
information is stored. 

[0006] Moreover, though the highlight scene can change with a lapse of time in such a live broadcasting 
program, the conventional system cannot appropriately correspond to the change in the highlight scene 
since once the scene is designated as a highlight, the scene will be stored in the receiving apparatus. 

[0007] The cause of such a problem is that the playback and viewing of the images and voice stored by the 
receiving side cannot be controlled by the broadcasting station side in the conventional a broadcasting 
system based on storage in consumer platforms. 

[0008] If the playback and viewing of the images and voice stored by the receiving side can be controlled b 
the broadcasting station side, which will serve such a viewing form that the viewer can playback and view ' 
the image relating to the broadcasting scene, which the broadcasting station (information provider) 
designates from the images stored, as the viewer viewing the currently broadcasting program For example 
in the case of the broadcast of a baseball game, the information provider exercises control such that only 
the images of past scenes relating to a batter at bat, who is now in tbe batter's box, can be replayed and 
viewed. Then, the viewer selects the playback and viewing as viewing the live broadcast of baseball game 
so that conditions of the batter's at bat so far can be seen from the replayed image. 

[0009] Moreover, if the viewer views the program from halfway, it is possible to replay the scenes which 
designated by the broadcasting station from the images stored, and to see a rough outline of the program. 

[0010] In consideration of the above-mentioned points, the present invention is one that improves the 
conventional system, and it is an aim of the present invention to provide a a broadcasting system based on 
storage in consumer platforms wherein a broadcasting side controls the playback and viewing of images 
and voice stored by the receiving side so as to make it possible to provide the broadcast services in various 
forms, and to provide a broadcast transmitting apparatus and a broadcast receiving apparatus of the 
system. 

[001 1] According to the present invention, in the a broadcasting system based on storage in consumer 
platforms comprising a broadcast transmitting apparatus for transmitting AV data composed of an image of 
a program and voice and a broadcast receiving apparatus having storing means for storing received 
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signals, wherein the broadcast transmitting apparatus multiplexes AV data and provision information 
designates AV data, intending to permit an information provider to replay and view in accordance with the 
display of the AV data, and transmits it, and the broadcast receiving apparatus makes it possible to replay 
and view only the AV data designated by the provision information corresponding to the AV data when 
displaying the received AV data. 

[0012] Whereby, information, which is created by the information provider of the broadcast transmitting 
apparatus side intentionally, is transmitted when the information provider intends, and the user of the 
broadcast receiving apparatus side can receive information as the information provider of the broadcast 
transmitting apparatus side intended, and can view a portion or the entirety of the program broadcast so far 
based on ttie information. 

[0013] Moreover, the broadcast transmitting apparatus comprises AV material storing means for storing AV 
data, AV material selecting means for selecting AV data from the AV material storing means, provision 
information storing means for storing the provision information, provision information selecting means for 
selecting provision information from the provision information storing means, multiplexing means for 
multiplexing the AV data selected by the AV material selecting means and the provision information 
selected by the provision information selecting means to generate a multiplexed signal, and transmitting 
means for converting the multiplexed signal to a broadcast signal in accordance with a transmission rule 
and transmitting it. 

[0014] Whereby, provision information linked to AV data, which the information provider of the broadcast 
transmitting apparatus has intentionally edited, can be provided as information relating to AV data, which is 
currently broadcasting, and the broadcast transmitting apparatus can control information to be provided 
according to the content of the program, which is currently broadcasting. 

[0015] Moreover, the broadcast receiving apparatus comprises receiving means for receiving a broadcast 
signal, separating means for separating data received by the receiving means into AV data and the 
provision information, AV data storage processing means for performing storage processing of the 
separated AV data, AV data storing means for storing AV data subjected to storage processing by the AV 
data storage processing means, AV data selecting means for selecting necessary AV data from the AV 
data storing means, AV data output controlling means for determining AV data to be externally output 
among AV data from the separating means and AV data from the AV data selecting means, presentation 
information storage processing means for converting the provision information separated by the separating 
means to the presentation information, presentation information storing means for storing the presentation 
information, presentation information selecting means for selecting the presentation information stored in 
the presentation information storing means to provide an instruction of selecting AV data to the AV data 
selecting means based on the selected presentation information, and presentation information externally 
outputting means for externally outputting the presentation information from the presentation information 
selecting means. 

[0016] Whereby, presentation information linked to AV data can be presented simultaneously with AV data 
separated at the same time, and the user arbitrarily selects the presentation elements of the presentation 
information, so that a portion or the entirety of stored AV data linked to the presentation element can be 
replayed, and the user can view stored AV data corresponding to the selected presentation element. 

[0017] According to the invention described in claim 1, the present invention comprises the a broadcasting 
system based on storage in consumer platforms comprising a broadcast transmitting apparatus for 
transmitting AV data composed of an image of a program and voice and a broadcast receiving apparatus 
having storing means for storing received signals, wherein broadcast transmitting apparatus multiplexes A\ 
data and provision information which designates AVdata intending an information provider to replay and 
view in accordance with the display of the AV data, and transmits it, and the broadcast receiving apparatus 
makes it possible to replay and view only the AV designated by the provision information corresponding to 
the AV data when displaying the received AV data. Whereby, information, which the information provider of 
the broadcast transmitting apparatus side has intentionally created, is transmitted when the information 
provider intends, and the user of the broadcast transmitting apparatus side can receive information as the 
information provider of the broadcast transmitting apparatus side intended, and can view a portion or the 
entirety of the program broadcast so far based on the information. 

[0018] The invention described in claim 2 is that the broadcast receiving apparatus generates and stores 
presentation information, which enables the uses to choose the playback and viewing of the AV data storec 
to correspond to the provision information. The broadcast receiving apparatus creates presentation 
information wherein provision information is associated with AVdata multiplexed at this time, and stores it, 
whereby performing the program viewing as the information provider intended even if the AV data is 
replayed after the broadcasting. 
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receiving apparatus comprises receiving means for receiving a broadcast signal, separating means for 
separating data received by the receiving means into AV data and the provision information, AV data 
storage processing means for performing storage processing of the AV data, AV data storing means for 
storing AV data subjected to storage processing by the AV data storage processing means, AV data 
selecting means for selecting necessary AV data from the AV data storing means, AV data output 
controlling means for determining AV data to be externally output by AV data from the separating means 
and AV data from the AV data selecting means, presentation information storage processing means for 
converting the provision information separated by the separating means to the presentation information, 
presentation information storing means for storing the presentation information, presentation information 
selecting means for selecting the presentation information stored in the presentation information storing 
means to provide an instruction of selecting AV data to the AV data selecting means based on the selected 
presentation information, and presentation information externally outputting means for externally outputting 
the presentation information from the presentation information selecting means. Whereby, it is possible to 
present the presentation information linked to AV data simultaneously with AV data separated at the same 
time, and the user arbitrarily selects the element of the presentation information. Since this allows the user 
to view a portion or the entirety of stored AV data linked to the element, the user can view the stored AV 
data corresponding to the selected presentation element. 

[0029] According to the invention described in claim 1 3, AV data received in real time is separated by the 
separating means to be output to an external device, and the AV data is stored in the AV data storing 
means, and the presentation information to be externally output is generated based on the provision 
information received in real time, and when anyl presentation information is selected therefrom, the 
corresponding data of the stored AV data is replayed. Since the program can be stored whenever 
necessary as outputting the program, which is on the air, it is possible to catch up with the program which 
is on the air, by performing playback in fast forward even while AV data broadcast so far in the program 
which is on the air, is reproducing, and it is possible to view the program even after the broadcast is ended. 

[0030] According to the invention described in claim 14, when the presentation information storing means 
stores the presentation information in advance and enabling information is transmitted from the broadcast 
transmitting apparatus, the presentation information selecting means selects presentation information 
which has been made available by the enabling information, from the presentation information stored in the 
presentation information storing means. The user can obtain only the provision information, which is made 
effective by the information provider at this time, from a large amount of presentation information stored 
and it Is possible to view a portion or the entirety of AV data stored so far based on the information. ' 

[0031] According to the invention described in claim 14, the presentation information storing means stores 
cuffing information that specifies a playback and viewing range of AV data transmitted from the broadcast 
transmitting apparatus, and the presentation information selecting means provides the instruction of 
selecting AV data to the AV data selecting means by use of the presentation information and the cuffing 
information. Because clarify the relationship between the presentation information and the cutting 
information is cianfied, the user can easily carry out edition agreeable to the user's taste Moreover the 
user can obtain intended information when the information provider intends. 

[0032] According to the invention described in claim 16, the way of selection of presentation information by 
the presentation information selecting means is limited based on a rule set by a user or an output history of 
AV data output from the AV data output controlling means. Whereby, provision information sent from the 
broadcast transmitting apparatus is converted to presentation information in the broadcast receiving 
apparatus, and the broadcast receiving apparatus can designate enabling information that makes only the 
limited presentation information effective. This makes it possible to reflect the information provider's 
intention in the information and to present enabling information for the user. Moreover, even if presentation 
information is stored in the broadcast receiving apparatus, the information provider of the broadcast 
transmitting apparatus transmits enabling information for extracting information to be currently provided 
whereby narrowing the present range of presentation information. Furthermore, the user of the broadcast 
receiving apparatus can fix enabling information that makes only the limited presentation information 
effective. This makes it possible to reflect the information provider's intention in the information and also to 
present enabling information for the user. 

[0033] The above structure and features of the present invention will be apparent from the following 
detailed description taken in conjunction with the accompanying drawings in which : 

Fig. 1 is a schematic block diagram of a broadcast system (broadcast transmitting apparatus and broadcas 
receiving apparatus) according to a first embodiment of the present invention- 
Fig. 2 is a view explaining provision information and AVdata according to the broadcast Iran smittina 
apparatus of the first embodiment; 

Fig. 3 is a view explaining the description of providing timing of provision information according to the 
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broadcast transmitting apparatus of the first embodiment, 

Fig. 4 is a view explaining transmission timing of provision information with ON/OFF according to the 
broadcast transmitting apparatus of the first embodiment, 

Fig. 5 is a view explaining transmission timing of provision information with effective time according to the 
broadcast transmitting apparatus of the first embodiment, 

Fig. 6 is a view explaining presentation information and AV data according to the broadcast transmitting 
apparatus of the first embodiment, 

Fig. 7 is an example of presentation information according to the broadcast transmitting apparatus of the 
first embodiment, 

Fig. 8 is a flowchart of transmission according to the broadcast transmitting apparatus of the first 
embodiment, 

Fig, 9 is a flowchart of provision information selection processing according to the broadcast transmitting 
apparatus of the first embodiment, 

Fig. 10 is a flowchart of presentation according to the broadcast transmitting apparatus of the first 
embodiment, 

Fig. 1 1 is a view explaining a provision information transmission unit according to the broadcast transmittinc 
apparatus of the first embodiment, 

Fig. 12 is a flowchart of provision information selection processing according to the broadcast transmitting 
anrarafll s of a second embodiment, 



Fig. 13 is an example of provision information when there is enabling information according to the 
broadcast transmitting apparatus of the second embodiment, 

Fig. 14 is an example of enabling information according to the broadcast transmitting apparatus of the 
second embodiment, 

Fig. 15 is an example of enabling information according to the broadcast receiving apparatus of the second 
embodiment, 

Fig 16 is an example of cuffing information according to the broadcast transmitting apparatus of a third 
embodiment, 

Fig. 17 is an example of cutting information according to the broadcast transmitting apparatus of the third 
embodiment, 

Fig. 18 is an example of provision information (playback control after storage) according to the broadcast 
transmitting apparatus of a fourth embodiment, 

Fig 19 is a configuration of the broadcasting system having an AVdata providing apparatus according to a 
sixth embodiment, 

Fig. 20 is a flowchart of AV data playback by the broadcast receiving apparatus having the AV data 
providing apparatus according to the sixth embodiment, and 

Fig. 21 is a flowchart of AV data transmission of the AV data providing apparatus according to the sixth 
embodiment. 

[0034] The following will explain embodiments of the present invention with reference to Figs. 1 to 21. 
(First embodiment) 

[0035] A broadcasting system according to the first embodiment, as shown in Fig.1, comprises a broadcast 
transmitting apparatus 100 and a broadcast receiving apparatus 200, and the broadcast transmitting 
apparatus 1 00 includes an AV material storing means 101 that stores data such as an image, a voice and 
the like (hereinafter referred to as AV data), an AV material selecting means 102 for selecting necessary 
AV materials from the AV material storing means 101 , a provision information storing means 1 1 1 that 
stores information linked to the AV materials (hereinafter referred to as provision information) an provision 
information selecting means 112 for selecting necessary provision information from the provision 
information storing means 1 1 1 , a multiplexing means 103 for multiplexing AV data selected by the AV 
matenal selecting means 102 and provision information selected by the provision information selecting 
means 112, and a transmitting means 104 for converting a multiplexed signal obtained by the multiplexinq 
means 103 to a transmission format to be transmitted. 

[0036] Also, the broadcast receiving apparatus includes a receiving means 201 for receiving broadcasting 
data in which AV data and provide data are multiplexed, a separating means 202 for separating 
broadcasting data received by the receiving means 201 into AV data and provision information linked to AV 
data, an AV data storage processing means 203 that performs storage processing of the separated AV 
data, an AV data storing means 204 for storing AV data subjected to storage processing by the AV data 
storage processing means 203, an AV data selecting means 205 for selecting necessary AV data from the 
AV data stonng means 204, an AV data output controlling means 206 for controlling AV data to be 
externally output by use of the AV data separated by the separating means 202 and of the AV data 
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selected by the AV data selecting means 205, a presentation information storage processing means 21 1 fo 
converting provision information to presentation information in such a form that keeps conjunction with 
multiplexed AV data so as to be stored, a presentation information storing means 212 for storing 
presentation information subjected to storage processing by the presentation information storage 
processing means 21 1, a presentation information selecting means 213 for selecting necessary 
presentation information from the presentation information storing means 212 so as to instruct the AV data 
selecting means 205 to select AV data, and a presentation information externally outputting means 214 for 
externally outputting presentation information selected by the presentation information selecting means 



[0037] The broadcast transmitting apparatus 100 in this system multiplexes data of an image and data of 
voice for a program, and information (provision information), which indicates a playback image t o be showi 
with this image, and sends them. 

[0038] On the other hand, the broadcast receiving apparatus 200 separates the multiplexed signal 
transmitted, stores image and voice data, and links provision information to multiplexed data of image and 
data of voice (i .e. , converts it to presentation information), and stores it. 

[0039] When a user views the image and voice of a program by use of the broadcast receiving apparatus 
200, presentation information linked to the viewed image and voice is presented, and if the user selects am 
presentation information, a playback image specified by the selected presentation information. 

[0040] The configuration of this system and the operation thereof will be more specifically explained. 

[0041] First, the configuration of the broadcast transmitting apparatus 100 in Fig. 1 will be specifically 



&lang&AV material storing means 101&rang& 



[0042] The AV material storing means 1 01 is a storage medium that stores AV data as material AV data 
stored is data of image and data of voice that makes up a program to be broadcast on TV in ordinary 
households, and that is presented in the forms of stream, or encoded form such as MPEG1, MPEG2 and 



[0043] As storage media, there are tape media in a cut machine for the image, which has been used 
SS V ?S n j£i n S« b ^ dcas,infl statioris - ln addition, there are, for example, a memory, HDD, PD, MD 
MO, DVD-ROM, DVD-RAM, DAT, D-VHS, and the like 



[0044] For reference sake, AV 



data can externally be added to the AV material storing means 101 . 



&iang&AV material selecting means 102&rang& 



[0045] The AV material selecting means 1 02 selects necessary AV data from the AV material storing 
ITvh"! fr ^ S ?'? ted AV data t0 the multiplexing means 103 as a broadcast signal. To selec 

AV data from the AV material storing means 101 , the means for externally selecting AV data is set up in th€ 
AV material selecting means 1 02 so that an information provider can select AV data manually. At this time 
GUI can be designed to facilitate the selection from the AV material storing means 1 01 . 

[0046] In addition, the AV material selecting means 102 also may be configured so as to include a 
broadcast schedule therein, and to automatically select AV data, which matches the schedule from the AV 
material stonng means 1 01 . 

K 71 ?£ th .f e ? ay fS ? ther i means for crea1 jng a broadcast schedule and managing it, and on the 
basis of the broadcast obtained therefrom, AV data may be automatically selected from the AV material 
stonng means 101. 



Alang&Provision information storing means 111&rang& 



[0048] The provision information storing means 111 is a storage medium that stores provision information 
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to deal with AV data efficiently and effectively. As the storage medium, there are HDD, PD, MD MO DVD- 
ROM, DVD-RAM, and the like. In addition, DAT, D-VHS, etc., can be considered as tape media. 

[0049] As shown in Fig. 2, provision information is composed of one or more elements (hereinafter referred 
to as provision element), each of the elements having a unit expressed by a character string or a symbol 
string or a combination thereof, and being added thereto linking information to AV data as its attribute, and 
this provision element is systematized in the form of a single hierarchy or a multilevel hierarchy. In a case 
where the respective provision elements of provision information are systematized in the form of a 
multilevel hierarchy, each provision element contains information of an attribute that shows which provision 
element each provision element has relationship with and what relationship each provision element has 
with such a provision element. 

[0050] Thus, each provision element of provision information includes linking information, which shows the 
entirety of the program broadcast so far or a portion or the entirety of the program to be broadcast or being 
on the air, as required. Then, this linking information can be changed with time regardless of whether or nol 
the program to be linked is on the air. 

[0051] Also, as shown in Fig. 3(a), an attribute of ON or OFF is added to each provision element of 
provision information as information for specifying the provision period. A provision element, which has 
been transmitted after adding OFF thereto, is displayed by a receiving side, and a provision element, which 
has been transmitted after adding ON thereto, is non-displayed by the receiving side. Namely, the provisior 
element transmitted with provision information in an ON state is continued to be effective as long as 
provision information in an OFF state is not transmitted. There can be considered a form in which each 
provision elements of provision information is pre-transmitted in an OFF state and stored in the receiving 
side, and only information, which is changed to be in an ON state later, is transmitted. 

[0052] Further, even if the reception is started at any time In a period for providing information, a signal of 
provision information in an ON state may be continued to be transmitted for a certain period of time as 
shown in Fig. 4 such that provision information of the time can be received. Also, there can be considered e 
transmission form wherein if a version is formed at provision information and the version is updated a 
portion or the entirety of provision information concerned is newly recreated and transmitted even if the 
same provision information is continued to be ON. 

[0053] Also, as shown in Fig. 3(b), it is possible to use a form wherein period information to be provided is 
added to each provision element of provision information as an attribute and the display of only the period 
at the receiving side is made effective and periods other than the period are set to non-display In this case 
as shown in Fig. 5, only the time, which is expressed by the attribute, serves as a provision time period 
after provision information is transmitted. 

[0054] Moreover, there can be consider a form in which information having an ON/OFF signal and an 
effective period signal combined is added to each provision element as an attribute. In addition it is 
possible to descnbe time information, which denotes how long this information has been transmitted in 
provision information or provision elements. Since this time information is a correct present start time of 
provision information, effectiveness of stored presentation information or presentation elements may be 
determined on the basis of this present start time when a recording and playback are carried out bv the 
broadcast receiving apparatus. 1 

[0055] Identification information for specifying the provision element such as a numeric string a symbol 
string, a character string may be added to the respective provision elements constituting provision 
information. In addition, identification information may be added to the provision information as such in 
order to specify the entirety of provision information. 

[0056] Furthermore, an identifier of AV data stored and time information of AV data (a starting time an 

SS^iS 1 ™ 0 / a A?/ U ^ 0 1 ti [T e f T J tl : e f! artiri9 a ° eriain time P eriod - etc > ma V be added to linking 
information to AV data to be added to the respective provision elements of provision information. Moreover 

i?5w 8 J°»* ara< J Br ^ e Hke ° ther than AV data is P° ssible - 11 is t0 be noted *<* linkin 9 information 

to AV data is not essential to the attributes of the respective provision information. Moreover, a total ami 
of time required when all of the AV data have been replayed may be described as an attribute of each 
provision element. 

[0057] For reference sake, provision information may be added externally to the provision information 
stonng means 111, or a provision information adding function that performs edition may be provided. 



&lang&Provision information selecting means 11 2&rang& 
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[0058] The provision information selecting means 112 selects a portion or the entirety of the necessary 
provision information from the provision information storing means 111 , sends the selected provision 
information to the multiplexing means 1 03, and instructs the multiplexing means 103 to multiplex the 
provision information. 

[0059] In order to select provision information, means for selecting provision information externally is 
provided, and this allows an information provider to select provision information (a portion or the entirety of 
provision information of Fig. 2) manually as viewing AV data before broadcasting, on the air, or after 
broadcasting. 

[0060] At this time, if the information provider views a certain AV data and selects provision information by 
the provision information selecting means 1 12, the AV data and provision information selected 
simultaneously with the AV data is sent to the multiplexing means 103. This is the same as the case in 
which telop is put on a screen depending on the situation in the conventional broadcasting, and this methoc 
makes it possible to transmit ON and OFF of provision information manually. 

[0061] Further, as mentioned above, since provision information may be updated with a lapse of time, there 
can be used a configuration in which the latest information is automatically sent to the multiplexing means 
103 when provision information is once selected and information of link of the provision information to AV 
data is updated. 

[0062] Moreover, provision information may be automatically selected in accordance with a predetermined 
schedule 



[0063] In addition, there can be considered a method wherein a key word is extracted from the constituent 
elements such as an image, a voice, etc., of the AV data on the air and provision information is selected 
based on information associated with the key word. 

[0064] Further, the selected provision information is repeatedly sent to the multiplexing means 103 
periodically, and if the provision of provision information becomes unnecessary, the provision information 
selecting means 112 instructs the multiplexing means 1 03 to stop multiplexing provision information 
Namely, provision information that is ON is continuously transmitted at regular intervals, and if the provisior 
of provision information becomes unnecessary, provision information that is OFF is transmitted. 

"IS? 5 ] f urthei : more . there can be used a form in which an attribute for specifying an effective period is 
added to provision information and the resultant is sent to the multiplexing means 103, and the multiplexinq 
means 103 performs multiplexing only for the period. 

[0066] If there is no provision information to be selected in the provision information storing means 111 
new provision information can be added to the provision information storing means 1 1 1 by use of the ' 
provision information adding function in the provision information storing means 111, while the selection 
and transmission thereof can be carried out simultaneously. 

[0067] For reference sake, the provision information selecting means 1 1 2 does not necessarily select 
provision information. «™»* 



&lang&MuKiplexing means 103&rang& 



[0068] The multiplexing means 103 multiplexes AV data output from the AV data selecting means 102 and 
provision information output from the provision information selecting means 1 12, and sends the multiplexed 
signal to the transmitting means 1 04. 



[0069] The multiplexing is performed in accordance with MPEG2 transport stream In s 
case in which only one of AV data and provision information is sent to the transmitting 

&lang&Transmitting means 104&rang& 

[0070] The transmitting means 1 04 converts the multiplexed signal received to a transmission format of a 
broadcast transmission line 401 , and performs transmission. 
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[0071] Next, the configuration of the broadcast receiving apparatus 200 of Fig. 1 will be specifically 
explained. 



&lang&Receiving means 201&rang& 



[0072] The receiving means 201 receives a broadcast signal transmitted from the broadcast transmission 
line 401 , and sends the received broadcast signal to the separating means 202. 



&lang&Separating means 202&rang& 



[0073] The separating means 202 provides a format conversion of the broadcast signal output from the 
receiving means 201, which is opposite to the transmitting means 104 of the broadcast transmitting 
apparatus 100, and performs processing thereof, which is opposite to the multiplexing means 103, to 
separate the signal into AV data and provision information. The separated AV data is sent to the AV data 
storage processing section 203 and AV data output controlling means 205. In addition, the separated 
provision information is sent to the presentation information storage processing means 211. 

[0074] For reference sake, a broadcast signal is not always composed of AV data and provision informatior 
multiplexed, and some broadcast signals are composed of only AV data. In this case, processing for only 
AV data is performed. 



&lang&AV data storage processing means 203&rang& 



[0075] The AV data storage processing means 203 obtains AV data from the separating means 202 and 
stores it in the AV data storing means 204. At this time, they are managed in the form such that a portion oi 
the entirety of AV data to be stored can be identified. For example, AV data in unit of program is managed 
by use of SI information and EPG information, information of the program (broadcasting station 
identification, program identification, and the like) and offset time from the program start time and the 
duration time, and the like are obtained from presentation information to be explained later, and a specific 
range of AV data is managed. Moreover, this management may be performed by use of time at which the 
broadcast signal has been received or identifiers (character string, symbol string, numeric string) divided by 
the broadcast receiving apparatus by itself. 

[0076] For reference sake, either of AV data in a stream format and AV data in a file format may be stored 
in the AV data storing means 204. 

[0077] In addition, all AV data received may be stored, the storage may be started by programming or all 
that the user has reviewed may be stored. 



&lang&AV data storing means 204&rang& 



[0078] The AV data storing means 204 is a storage medium that stores AV data output from the AV data 
storage processing means 203. As the storage medium, there are a memory, HDD, PD MD MO DVD- 
ROM, DVD-RAM, and the like. In addition, DAT, D-VHS, etc., can be used as tape media. ' ' 



&lang&AV data selecting means 205&rang& 



[0079] The AV data selecting means 205 selects a portion or the entirety of the necessary AV data and 
sends the selected AV data to the AV data output controlling means 206. At this time, the AV data selecting 
means 205 performs the selection of AV data on the basis of information for selecting AV data from the 
presentation information selecting means 213, or performs the selection on the basis of information such a: 
identifiers of AV data stored in the AV data storing means 204 or time information of AV data (a starting 
time, an offset time of a duration time from the starting time, a certain time period, etc.). 
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[0080] Moreover, it is possible to provide inputting means that can select AV data externally in the AV data 
selecting means 205 such that the user can directly select AV data from the AV date storing means 204. 
This is the same as the general video operation. 



&lang&AV data output controlling means 206&rang& 



[0081] The AV data output controlling means 206 controls AV data to be externally output, that is, AV data 
to be currently broadcast by use of AV data separated from the separating means 202 and AV data output 
from AV data selecting means 205, to send the controlled AV data to the AV data externally outputting 
means 207. 



[0082] Here, to control AV data to be sent to the AV date externally outputting means 207, for example, AV 
data switching is performed. Namely, AV date, which has been just received, and AV data stored are 
switched and output. 

[0083] For example, when AV data broadcast so far is received from the AV data selecting means 205, 
these AV data is output without fail. Or, when AV data that is input from the AV data selecting means 205 is 
output to the AV data externally outputting means 207, and AV data input from the AV data selecting 
means 205, that has been broadcast so far, has caught up with AV data, which is input from the separating 
means 202 and currently, on the air or AV data corresponding thereto, at the same time. At this lime the 
external output is switched to AV data that is input from the separating means 202. 

[0084] For reference sake, as a method for controlling AV data to be sent to the AV data externally 
outputting means 207, it is possible to combine two AV data and output it. For example, AV date can be 
output in such a form that a screen on which AV data from the separating means 202 and AV data from the 
AV data selecting means 205 are displayed is divided into two, or one of two AV data is superimposed on 
the other and displayed. 



&lang&AV data externally outputting means 207&rang& 



[0085] The AV date externally outputting means 207 externally outputs AV date output from the AV data 
output controlling means 206. As an externally outputting method, for example, outputting is carried out by 
a display device for outputting an image such as TV, CRT, a liquid crystal display, a projector a plasma 
display, and the like and a speaker such as a speaker. 



&lang&Presentation information storing means 212&rang& 



[0086] The presentation information storing means 212 is a storage medium that stores presentation 
information output from the presentation information storage processing means 21 1 As the storage 
Medium, there are a memory, HDD, PD, MD, MO, DVD-ROM, DVD-RAM, and the like. In addition DAT D- 
VHS, etc., may be used as tape media. 

[0087] For reference sake, the presentation information storing means 212 may be the same media as that 
of the AV data storing means 204. 

[0088] Here, presentation information is information that converts the provision information to keep the 
relationship with AV data multiplexed simultaneously with the received provision information and that is 
managed. Examples of the presentation information are shown in Figs. 6 and 7. 

[0089] As shown in Fig. 6, in the presentation information, the configuration in which the respective 
provision elements transmitted by provision information are systematized is grasped as a configuration of 
the presentation elements corresponding to the provision elements (Fig. 6 (a)), and the presentation 
elements are managed as in a presentation element management of Fig. 6 (b). In this presentation elemeni 
management, the presentation elements are described by an element ID and an element name and the 
node structure of the presentation elements are described by an upper node, a node relationship and a 
present order at the upper node. Further, AV date of the target link of the presentation elements are 
described as AV data linking information for specifying an output AV and its time period. 

[0090] In addition, the relationship between presentation information and AV data that is multiplexed into 
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the presentation information is managed by describing a presentation ID of presentation information, 
identification information (AV to be presented) of multiplexed AV data and the time information (present 
time period) to be associated with each other. 

[0091] Moreover, as shown in Fig. 7 (b), it is possible to add the presentation AV and the present time 
period to the presentation element as its attribute so as to maintain the relationship with AV data every 
presentation element and to manage the relationship. 

[0092] Such a management is performed to output multiplexed provision information together with the AV 
data simultaneously when AV data is output. Accordingly, a portion or the entirety of Fig. 6 (a) (part of 
provision information of Fig. 2) of the corresponding presentation information is simultaneously output in 
accordance with the output of AV data. 



&lang&Presentaton information storage processing means 211&rang& 



[0093] The presentation information storage processing 21 1 obtains provision information from the 
separating means 202, and converts provision information to a form that maintains the relationship with the 
simultaneously multiplexed AV data obtained by the AV data storage processing means 203, and stores it 
in the presentation information storing means 212 as presentation information. The conversion to the form 
that maintains the relationship with AV data means to perform conversion so as to output the provision 
information multiplexed simultaneously with the AV data at the same time. 

[0094] Here, in order to convert provision information to the form that maintains the relationship with AV 
data, presentation information is managed at a broadcast time period when AV data is managed at 
broadcast time (Fig. 7 (a)). Namely, since provision information itself transmits only information, which is 
effective at the instance when it is transmitted, management is performed such that a time period in which 
the presentation information is effective is recognizable. 

[0095] For example, when a signal is received, which says that provision information is ON at 19:00, it is 
assumed that the effective period of this provision information is 19:00 to 19:10 at the time of 19:10 and is 
19:00 to 19:20 at the time of 19: 20, until the same provision information receives a signal OFF at 20:00. 
Thus, provision information can be converted in the form that maintains the relationship with AV data by 
continuing to update the effective period of the presentation information. 

[0096] Moreover, even in the case of management every presentation element as shown in Fig. 7(b) the 
updating of the effective period of the presentation element may be continued as the same whenever 
necessary. 

[0097] In a case where the received provision information is always presented, provision information from 
the separating means 202 is not necessarily stored in the presentation information storing means 212 as 
presentation information converted to the form that maintains the relationship with AV data simultaneously 



&lang&Presentation information selecting means 213&rang& 



[0098] The presentation information selecting means 213 selects a portion or the entirety of necessary 
presentation information from the presentation information storing means 212, and sends it to the 
presentation information externally outputting means 214. Moreover, the presentation information selecting 
means 213 compnses externally inputting means that can select an arbitrary presentation element from 
presentation information currently selected. The user can select an arbitrary element from this externally 
inputting means. 

[0099] Furthermore, in a case where presentation information is selected from the presentation information 
storing means 212, the presentation information and AV data are externally output in the form that 
maintains the relationship in the time when they are multiplexed as a multiplexed signal. For example in a 
case where a reference time is provided and the presentation information selecting means 213 selects 
presentation information corresponding to a certain reference time, the AV data output controlling means 
206 also selects AV data corresponding to the time, whereby implementing the above. 

[0100] Moreover, the presentation information selecting means 213 may always select the latest 
presentation information automatically. Alternatively, the presentation information selecting means 213 ma\ 
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directly receive notification of updating of presentation information and select presentation information 
based on this notification. 

[0101] Further, there is a case in which the presentation element is selected by the aforementioned externa 
means or the element of presentation information is automatically selected. If information (AV data linking 
information) for reproducing stored AV data is described in the element of the selected presentation 
information, in the above case the presentation information selecting means 213 instructs the AV data 
selecting means 205 to select the corresponding AV data. 

[0102] Moreover, if the presentation information is hierarchically structured, the instruction for selecting AV 
data is provided to the AV data selecting means 205 only after an instruction element for reproducing AV 
data has been selected. 

[0103] Furthermore, the presentation information selecting means 213 may be provided with means for 
selecting the element automatically based on presentation information. This makes it possible to replay AV 
data in order based on linking information to AV data, by adding an attribute that is an automatic playback 
to each presentation element of presentation information. 



Alang&Presentation information externally outputting means 214&rang& 

[0104] The presentation information externally outputting means 214 is means for externally outputting 
presentation information output from the presentation information selecting means 213. As an externally 
outputting method, for example, outputting is carried out by a display device for outputting an image such 
as TV, CRT, a liquid crystal display, a projector, a plasma display, and the like and a speaker such as a 
speaker, etc. 

[0105] In addition, since means for outputting AV data and means for outputting presentation information 
are separately provided, it is possible to take a form that AV data is output by TV and presentation 
information is output by a remote control unit, whereby acquiring presentation information without 
obstructing AV data. 

[0106] For reference sake, AV data and presentation information may be presented on the same screen In 
the case of TV, for example, AV data is output onto the screen and presentation information may be 
presented thereon. In addition, an area where AV data is output may be reduced to present the 
presentation information on a residual part. 

[01 07] For reference sake, such a function may be mounted on the aforementioned AV data externallv 
outputting means 207. 1 



&lang&Specific example&rang& 



[01 1 08] Next, an actual operation of the broadcast system in which the broadcast transmitting apparatus 1 0C 
and broadcast receiving apparatus 200 are combined and the examples of services will be explained. 

[0109] Suppose a model wherein the broadcast transmitting apparatus 100 transmits provision information 
^n! eC ^) g rt based on AV data of the P ro 9ram, which is on the air and the broadcast receiving apparatus 
200 directly outputs presentation information to be associated with AV data 



&lang&Exampie of provision information&rang& 



[0110] First, an example is given of dealing with provision information in the broadcast transmitting 
apparatus 1 00. Fig. 2 shows an example of provision information stored in the provision information storing 
means 1 1 1 . This is an example of provision information in the broadcast of a baseball game and the 
provision elements indicate a portion or the entirety of AV data, which has been broadcast so far or which i< 
on the air. AV data indicated by the provision elements of this provision information changes with the 
passage of time and the progress of the broadcast of the program. 

[01 1 1] For example, there is a case wherein a baseball game between a G team and a T team is broadcast 
live. Suppose that the G team was in the lead at the time of 20:00, and AV data of the G team at this time 
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was used as a highlight. However, if the T team won the game at the time of 21 :00, there is possibility that 
the previous AV data of G team used as a highlight will becomes unnecessary because of the victory of the 
T team. 

[0112] Next, as a selective range of provision information, "broadcast of baseball game" and all afterward 
can be selected as provision information by the provision information selecting means 112, or "A player" 
and all afterward can be partially selected as provision information, or only "A player" and "B player" of "G 
team" can be selected as provision information. 

[0113] Moreover, in order to designate the provide period of provision information, ON/OFF is provided to 
each element of provision information, provision information to be desirably displayed is transmitted with an 
attribute of ON, and provision information to be desirably non-displayed is transmitted with an attribute of 
OFF. Fig. 3(a) shows that provision elements of "at bat" of "A player" and "abbreviated viewing" are 
currently displayed and the other elements are non-displayed. 

[0114] In the above example, the respective provision elements of provision information indicated a portion 
or the entirety of AV data, which has been broadcast so far or which is on the air. However, the provision 
elements of provision information may indicate a portion or the entirety of AV data of programs that will be 
broadcast hereafter or that are broadcast in other broadcasting stations. 



&lang&Example of presentation information&rang& 



[0115] Next, examples are given of dealing with presentation information in the broadcast receiving 
apparatus 200. Figs. 6 and 7 show examples of presentation information stored in the presentation 
information stonng means 212. This is an example of provision information in the broadcast of a baseball 
game. In Fig. 6, the provision elements indicate a portion or the entirety of AV data, which has been 
broadcast so far or which is now on the air. The presentation element management shown in Fig 6 (b) is 
composed of a presentation object, which shows a presentation element ID and an element name, node 
constituent information for showing the relationship between nodes such as an name of upper node the 
relationship with the element and a presenting order in the same hierarchy, and AV data linking information 
which shows a link between information for identifying AV data and the corresponding AV data such as a 
time period. 

[01 16] Since this is based on the assumption that provision information of Fig. 2 will be received the 
management depends on the provision information. For reference sake, any combination of these items 
(presentation element ID, name of element, upper node, and the like) in the presentation element 
management may be formed. 

[0117] Further, in Fig. 7(a), identification information (AVto be presented) of time information (presenting 
time penod), which have been simultaneously multiplexed, are added to the provision information and the 
management is performed to maintain the relationship between provision information and AV data 
separately for each transmitted provision information. Presentation information of presentation ID = 10001 
shows that AV data is effective at 1 9:02 to 1 9:03 among AV data of "broadcast of baseball game in 1 999" 
and present data of presentation ID = 10002 shows that AV data is effective at 19:53 to 19:54 amona AV ' 
data of cooking class". a 

[0118] Furthermore, in Fig. 7(b), identification information (AVto be presented) of time information 
(presenting time period), which have been simultaneously multiplexed, are added as attributes of 
presentation information, and the management is performed to maintain the relationship between 
presentation information and AV data, separately for each presentation information. The presentation 
element of at bat shows that AV data is effective at 19:02 to 19:03, 19:20 to 19 40 and 19 53 to 19 54 
among AV data of "broadcast of baseball game in 1 999". The relationship of nodes shows that the 
presentation element of "A player" is its parent and is to be presented at the first in the same hierarchy In 
addition, the presentation element of "profile" shows that AV data is effective at 1 9 02 to 1 9 03 1 9 53 to 
1 9:54 among AV data of "broadcast of baseball game in 1999". The relationship of node shows that the 
presentation element of A player is its parent and is to be presented at the second in the same hierarchy. 
Moreover, AV data of "baseball yearbook" is linked at 18:35 to 18:40. 



Slang&Operation flow&rang& 



[01 1 9] Next, the following will explain an example of a flow up to transmission of AV data and provision 
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information in the broadcast transmitting apparatus 100 with reference to Figs. 8 and 9. 

[0120] Here, step 1 1 05 of Fig. 8 is shown in Fig. 9. An information provider selects an AV material from the 
AV material storing means 101 by use of the AV material selecting means 102 at a program starting time oi 
immediately before the start (step 1 1 01). Then, if the program is not ended (step 1 1 02), processing for 
transmitting the selected AV material as stream data is performed, so that AV stream data to be currently 
transmitted is created (step 1 103), and the created data is sent to the multiplexing means 1 03 (step 1 1 04). 
If the program is ended in step 1102, end processing (step 1108) is carried out, and the operation is ended. 



[01 21]. Next, in a provision information select processing step 1105, the information provider views the 
content of AV data, which is currently on the air, and selects provision information relative to the content 
from the provision information storing means 1 11 by use of the provision information selecting means 112 
(step 1 1 1 1), and sends the selected provision information to the multiplexing means 1 03 (step 1112). Then 
broadcasting AV data and selected provision information are multiplexed (step 1106), and transmitted (step 
1107). In addition, if the information provider does not select provision information in step 1111, only strean 
data of AV material is transmitted (steps 1 1 06, 1 1 07). 

[0122] This makes it possible to transmit relevant provision information to AV data, which is currently on the 



[0123] The information provider performs the selection from the stored provision information in step 11 11. 
However, it is possible to use a manner, in which provision information newly created when necessary is 
selected and transmitted. In addition, it is possible to use a manner in which AV data and provide data are 
linked in advance, and provision information is transmitted simultaneously with AV data. 

[0124] The element of provision information to be selected is linked to some of entirety of AV data 
broadcast so far. In order to indicate linked AVdata, for example, the starting time and reproducing time an 
added to each element. In addition, provision information may be linked to AV data to be broadcast from 
hereafter. 



[01 25] Next, Fig. 1 0 shows an example of a flow in which the broadcast receiving apparatus 200 receives a 
broadcast signal (AVdata, provision information, and the like) from the broadcast transmitting apparatus 
1 00, and the user selects an arbitrary element from the provision information, and replays AV data 
corresponding to the selected element. Hereinafter, the explanation is given on the assumption that all 
broadcasts so far would be stored. 

[0126] First, the receiving means 201 and separating means 202 of the broadcast receiving apparatus 200 
receive a multiplexed broadcast signal (AV data, provision information, and the like) from the broadcast 
transmitting apparatus 100, and separate the received signal to AV data and provision information 
respectively (step 1201). Then, if there is provision information in the received broadcast signals (step 
1202), the provision information storage processing means 211 stores presentation information converted 
to the form that maintains the relationship with multiplexed AV data in time (step 1203) If there is no 
provision information therein, the presentation information storage processing means 211 is on standby 
until the reception of provision information (step 1202). 

[0127] The presentation information selecting means 213 selects presentation information to be currently 
presented from the presentation information storing means 212, and the presentation information externally 
outputting means 214 presents the presentation information (step 1204). 

[0128] Then, in a standby state until the user selects an arbitrary element from the presentation information 
presented if the user selects an element (step 1 205), the AV data selecting means 205 selects AV data 
from the AV data storing means 204 based on linking information to AV data described n the selected 
element (step 1206), and the AV data output controlFrng means 206 determines that stored AV data is 
replayed, and the AV data externally outputting means 207 replays the AV data (step 1207). 

[0129] Therefore, by reproducing stored AV data, which the information provider has intentionally edited as 
information relating to AV data, which is currently broadcast when the information provider wishes the user 
of the broadcast receiving apparatus 200 can view AV data broadcast so far in a form that reflects'the 
information provider's intention. 

l 01 ™L^ ef !? n _, ce sake ' in step 1205 ' the Presenting period of presentation information can be controllec 
by ON/OFF added to the provision information. Namely, when received provision information is ON, display 
is carried out, and when it is OFF, non-display is carried out. If provision information ON is continuously 
received, presentation information is updated. In addition, if ON is continuously received the determination 
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of update may be carried out as considering the version of provision information. Moreover, if the 
presentation information selected by the user is updated, the old presentation information may be used as i 
is, or forcibly changed to new one. 

[0131] For reference sake, in step 1205, the period for displaying presentation information may be set to a 
certain fixed period or determined based on period control by the broadcast transmitting apparatus 100. 

[0132] Moreover, in step 1205, the operation may be unconditionally moved to step 1206 without the user's 
selection to replay AV data. 

[01 33] Further, in step 1205, if presentation information has the hierarchical structure, a step for searching 
presentation information hierarchically. This hierarchical processing may be performed by the presentation 
information selecting means 213. 

[0134] Furthermore, in linking information to AV data in provision information, it is possible to describe an 
AV data reproducing method such that instructs the order to replay AV data, or if AV data are presented on 
divided parts of the screen or are presented overlaying one on another. 

[0135] In addition, it is possible to configure the provision elements such that they indicate not only AV data 
but also data such as character information stored in the broadcast receiving apparatus, or store data such 
as character information therein to be provided. 

[0136] Thus, the use of means for providing intended information when the information provider intends 
makes it possible to provide the following services to the user. 



Aiang&Example of services&rang& 



[0137] It is assumed that the baseball game is broadcast live, and that AV data of the broadcast of the 
baseball game so far are stored since the start of the game. Then, it is assumed that a scene is just 
broadcast in which A player is at bat. Then, the information provider starts to transmit provision information 
linked to AV data relating to the A player so far as ON. Since this provision information may be one that the 
information provider wishes to provide to the user, for example, all scenes of A player's at bat so far can be 
provided by AV data and a profile such as A player* batting average can be provided by character 
information. 

[0138] Referring to Fig. 2, in the case where all scenes of A player's at bat are provided by AV data 
provision information may be given in a form of "at bat" of "A player" (Fig. 1 1). The broadcast receiving 
apparatus 200 replays scenes all scenes of A player's at bat so far from AV data stored so far by use of 
received provision information, whereby the user can obtain service that information relating to A plaver car 
be seen while A player is at bat. a F 1 

[0139] In addition, the content of the service in the form of "at bat" of "A player" differs depending on time 
when the user wishes to view all scenes of A player's at bat. Namely, if "at bat" of "A player" is selected 
when A player is at bat the second time, only AV data of A player's first time at bat can be replayed since 
the information provider has transmitted only provision information linking to AV data of A player's first time 
at bat. However, when A player is at bat the third time, AV data of A player's first and second times at bat 
can be replayed since the information provider additionally creates provision information linking to AV data 
of A players second time at bat and transmits it. However, when A player left the batter box, the informatior 
P , r ?, V, A er ^° not have t0 provide informatior « relating to A player any more. Accordingly, provision informatioi 
of at bat of "A player" is transmitted as OFF, so that the user cannot view AV data of A player so far. 

[0140] For reference sake, in a case where the user wishes to view all scenes of A player's at bat so far 
when A player is now in his second turn at bat, the user can view all scenes of A player's at bat in the first 
and second turns, if provision information is linked to the broadcast AV data not only in his first at bat but 
also in his second at bat. 

[0141] Moreover, in the broadcast receiving apparatus, there is a service of "abbreviated viewing" This is 
the service in which only the noticeable scenes from the stored baseball broadcast so far by the broadcast 
receiving apparatus are abbreviated and served, if "abbreviated viewing" element of presentation 
information is selected when "abbreviated viewing" element of presentation information is displayed on the 
screen. This is on the assumption that the information provider links the noticeable scenes so far to the 
element of abbreviated viewing", and the information provider updates the content of the abbreviated 
viewing whenever necessary by use of the broadcast transmitting apparatus. As a result the scene a 
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subject to be abbreviated and viewed differs in accordance with the selected time, so that effective 
abbreviated viewing services are given to the users. 

[0142] At this time, if the information provider provides information such as "abbreviated viewing " service 
that the provider wishes to continue providing, the broadcast transmitting apparatus may transmit provision 
information, serving as an attribute of provision information, wherein "abbreviated viewing" is ON at a 
program starting time, and may transmit provision information wherein "abbreviated viewing" is OFF only at 
a program ending time. In addition, for adding providing period information to the element of provision 
information, that is, "abbreviated viewing", the period from the start and to the end of the program may be 
added thereto as an attribute of the element of the corresponding provision information. Namely, for a two- 
hour program, providing period information may add an attribute of "effective for two hours" to the element 
of provision information. 

[0143] For reference sake, in a case such as a drama that has already created as a program, the broadcas 
transmitting apparatus may set the selection timing of AV data and provision information, selection timing ir 
advance of broadcasting the program since selective timing of AV data and provision information is 
determined. 



[0144] Using the above mentioned provision information, the following is also possible. That is for viewinq 
AV data stored so far and viewing AV data of other channels, a point of AV data, which is currently viewed 
is stored. Then, the reproducing of the stored AV data is started from the stored point of AV data when 
viewing the same channel next time. 

£l 4 r^Sf iSnS^ ? b ^'J n I hiS St ° rage ^ broadcast ^tem the information provider can provide the 
user with information linked to the program broadcast so far, relating to AV data now on the air, which has 
been changed depending on providing time and intentionally edited by the information provider. In the 

ElS! ? aw HT*"!? ^ Can ° 0ntro1 the information . which the information provider wishes to provide, 
finking to AV data, which is currently on the air. 

[0146] In addition provision information linked to the program broadcast so far is presented as information 
o be presented simultaneously with AV data, which is currently on the air, and the' user arMrl^eT 
information therefrom. This allows the user to easily view a portion or the entirety of AV data stored. 

!?n^Il Th t 1 ! JSer « el ! CtS , a A w e l ement arbitraril V from Presentation information, which is currently presented a 
Snn ilrm f^a ^^l^ " the broadcast receivin 9 a PP aratus can ° a replayed based on 
linking information to AV data, which has been added to the element and which has been intentionally 

vil e ?h y luf!T atl ? P r ider ° f the broadcast transmitting apparatus. Then, the user can effectively 
S so far or the AV data now being on the air reflecting the information provider's 



(Second embodiment) 



[0148] In the a broadcasting system based on storage in consumer platforms of the second embodiment 
"? f0rmat0n ,s Emitted from the broadcast transmitting apparatus to the broadcast receiving 
apparatus in advance, and enabling information that makes the provision information effective is 
transmitted thereafter. 

St0ring means 111 > P rovision information selecting means 112 
separating means 202 presentation information storage processing means 21 1, presentation information 

5 w7be n expl ' "? presentation information selecHn 9 means which are different from Se e? 



&lang&Configuration of broadcast transmitting apparatus&rang& 



&lang&Provision information storing means 11 1&rang& 



Elf 1 raspective provision elements of provision information stored in the provision information storinc 
Fnr Z\V~n H t attnbute * f °[ Sea f C i ing * e provision elements as well as linking information to AV (fate 
For this reason, it is possible to select only a provision element that has an attribute satisfying a certain 
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condition. For example, for providing the search result for the batting average and homer, as shown in Fig. 
13, attributes, which denote the balling average and homer of each baseball player by a numeral value 
may be added. Moreover, by adding the item of "baseball player" to the attributes of the provision elements 
such as "batting average" and "profile", the provision elements such as "batting average" or "profile" can be 
searched. The relationship between the provision elements is included as an attribute. Namely, in a case 
where the provision element of "at bat" is added to the attribute of the provision element of "A player", a 
search for "provision element of A player and below" is possible. Thus, using this attribute, the user can 
search only for the provision element, which the information provider wishes to provide to the user. 

[0151] Furthermore, similar to the first embodiment, the provision information itself or the respective 
elements of provision information may include ON/OFF, which makes them effective or ineffective, and tirm 
period. 

[0152] Moreover, the provision information storing means 111 stores controlling information (hereinafter 
referred to as enabling information, see Fig. 14) that can make a portion or the entirety of the necessary 
provision information effective. In the aforementioned examples of "baseball player", "at bat", and "profile" 
^baseball player" Is the attribute of provision element, and is also enabling information. Further, "at bar and 
profile" correspond to the provision elements. Furthermore, this enabling information can be input from the 
outer section. In addition, in enabling information time information may be described, the time information 
indicating how long the information has been transmitted. Since this time information indicates a correct 
enabling starting time of the enabling information, enabling information stored may be made effective base< 
on this effective starting time when recording and reproducing are performed in the broadcast receiving 
apparatus. 

Alang&Provision information selecting means 112&rang& 

[0153] The provision information selecting means 112 selects two kinds of provision information Regarding 
one kind of provision information, all basic provision information is selected from the provision information 
storing means 1 1 1 , transmitted to the multiplexing means 103, and the multiplexing means 103 multiplexes 
the provision information into AV data, which is currently on the air, and the transmitting means 104 
transmits the resultant. Regarding the other kind, enabling information is selected from the provision 
information storing means 1 1 1 that can make necessary provision information or a portion or the entirety of 
the provision elements effective, and the selected enabling information is subjected to multiplexing and 
transmitting in the same manner as the above. 

P154] For reference sake, enabling information can be input externally and be selected, as well as selectee 
from the provision information storing means 111. 

[0155] Regarding the enabling information, not only the provision elements of provision information but a 
script having an attribute of provision element as a condition also may be used. For example "Ditcher with 
10 or more wins" or "element of A player and below" may be used. 

[0156] Similar to the transmission timing of provision information of Fig. 4 in the first embodiment, enabling 
romLTnl « ^ ON and OFF modes, if transmission is performed in ON mode, the enabling information 
remains effective. Then if transmission is performed in OFF mode and the corresponding enabling 
l~ on 's effective, the enabling information becomes ineffective. In addition, similar to the transmissio. 
timing of provision information of Fig. 5 in the first embodiment, the effective time period of the enabling 
information may be described in the enabling information, and the enabling information becomes effective 
at the receiving side only for that period. Namely, enabling information may be transmitted in advance. 

&lang&Conflguration of broadcast receiving apparatus&rang& 



Alang&Separating means 202&rang& 

£l 5 7l The se . parat ! n ? means 2 f 02 separates the broadcast signal received by the receiving means 201 into 
« 1 t \P rovislon information for providing AV data, and enabling information for selecting a portion or the 
entirety from provision information. 
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&lang&Presentation information storage processing means 211&rang& 



[0158] The presentation information storage processing means 211 stores basic provision information to 
the prevent information storing means 212. Then, the presentation information storage processing means 
21 1 sends enabling information to presentation information selecting means 213 when receiving the 
enabling information. 

[0159] For reference sake, when enabling information is received, the presentation information storage 
processing means 21 1 may store enabling information together with time information to keep the 
relationship in time with AV data multiplexed simultaneously with the enabling information. Thus, when the 
AV data is replayed after storing, enabling information multiplexed simultaneously with the AV data being 
replayed is sent to the presentation information selecting means 213, with reference to time information of 
stored enabling information. 



&lang&Presentation information storing means 212&rang& 



[0160] The presentation information storing means 212 stores basic presentation information stored in 
!£r!e Ce ' k, °T e w ; ere t ena b'ir»g information is stored, the presentation information storing means 212 
stores enabl ng information together with AV data identification information (AV to be presented) and time 
-"formation (effective time period) to keep tne relationship in time with AV data multiplexed simultaneously 
a ^in^ 9 "S ° n (Rg " 15 L Similarto the case in which the presentation information storage 
ESSKT'f "« S !° re ! P u-f entat0n information ^ the first embodiment, the effective period of 
infnSnn Th Whl, f Upd . ating time irrformati °n the ON to OFF mode of enabling 

^^'F^^^^ST^ inf ° rmat r ID ' enab,ing inf ° rmati0n ' AVt0 be P fesented . a "d 
J'S -Z 9 ' ■* P ? the data mana 9 |n 9 form, so that they are for the purpose of showing the 
example. These items may be configured by any combination. a 

inform I?! reference sa * e ' in * he Presentation information storing means 212, basic presentation 

S2SSSSnTSfa5SS2S n0d W K th , tim H inf0 . rmati0n t0 be St0red " This makes jt P*»«*» to change basic 
Sfnn^ta r. T? / « broadcastna - P"*™ or depending on time period, and to bring about 
changes in presentation information to be selected, since basic information to be searched differs from 
each other even in the same enabling information. 

LnlSL^nn 6 '' P rese " te tion information may be created or added originally by the broadcast receivina 
&!ang&Presentation information selecting means 21 3&rang& 

Eel^E^ St0rage ^^"S means 211 dire c«y sends enabling information to 

21 \3 ca se ?d £t" 86 f? " g . meanS , 21 3 J whereb y the Potation information selecting means 
^13 can select effective presentation information from the presentation information storina mean* 4iT 

ss£s.s. e - 8 ? abi i? info : mation - At time > jt is p° ssib ^ to store zsssz^ijsr 

^ S information stonng means 212 while passing the enabling information directly to the 
presentation information selecting means 213. 

[0164] For reference sake, the presentation information selecting means 213 may extract the latest 
enabling information in time to the presentation information storing means 212 ! from storXnSa 

!2Z5!5'h and Sel !? effeCtiVe Potation information from 1h?p^Ko^r^ 8 
means 21 2 based on the extracted enabling information. 'mormanon 

\^S3ZT eT ^ the CaS f * heT - e the P resenta tion information selecting means 21 3 selects presentation 
fn^l L h he prese " tat10 " '"formation storing means 212 based on the enabling infoTmation a 
general search engine and a natural language processed search engine may be used 



&lang&Specific explanation&rang& 



[0166] Next, suppose a model wherein the broadcast transmitting apparatus transmits rough provision 
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information in advance, enabling information for making a portion or the entirety of transmitted provision 
information effective is selected based on the AVdata now on the air, and simultaneously transmitted, and 
a portion or the entirety is extracted from presentation information stored based on enabling information 
received by the broadcast receiving apparatus, and is output. 



&lang&Example of provision information and that of enabling information&rang& 



[0167] Here, an example of provision information transmitted from the broadcast transmitting apparatus is 
shown in Fig. 2 and 13, and an example of enabling information is shown in Fig. 14. Since the respective 
elements of this provision information have an attribute of the information together with linking information 
to the AV data broadcast so far, the respective elements of provision information can be selected only by 
indicating the provision information itself or pointing out the attribute satisfying a certain condition using 
enabling information. 

[0168] For example, if "abbreviated viewing" is transmitted as enabling information by the broadcast 
transmitting apparatus, only a presentation element of presentation information, that is "abbreviated 
viewing" becomes effective in the broadcast receiving apparatus, and only one presentation element of 
■abbreviated viewing" is extracted. Moreover, if "player having batting average .250 or more" is transmitted 
as enabling information, two or more presentation elements of presentation information such as "A player" 
and "B player" can be extracted. K ' 



&lang&Example of presentation information and example of enabling information&rang& 

[0169] Next, the following will explain the examples of presentation information and enabling information in 
the broadcast receiving apparatus. Presentation information has a form in which the attributes that can be 
searched and extracted by enabling information as shown in Fig. 14 is added to the presentation elements 
or hig. 6 and Fig. 7. Further, in the enabling information stored, identification information of AV data 
multiplexed simultaneously with the enabling information and the effective time period of the enabling 
information are stored in the form that they are described in the respective elements (broadcasting of 
baseball game and the afterward", "abbreviated viewing", and the like) of Fig. 14 (see Fig. 15). 

[0170] Thus, the information provider transmits provision information in advance. Then, the information 
provider may transmit only enabling information that can be extracted from the provision information 
transmitted in advance. This makes it possible to facilitate the information provider's operation In addition 
this makes it possible to reduce the amount of data transmission in real time. There can be considered a ' 
method in which provision information and enabling information are transmitted simultaneously and only th« 
effective provision information is extracted from the provision information based on the enabling 
information . a 



&lang&Operation flow&rang& 



[0171] Next, Figs. 8 and 12 illustrate an example of a flow up to transmission of AV data and provision 
information in the broadcast transmitting. Here, step 1 1 05 of Fig. 8 is shown in Fig. 12. Since Fig 8 has 
been already explained, Fig. 12 will be explained here. In Fig. 12, the information provider views the 
PT0 ?!??'™ h [ ch J S current| y on the air, and selects provision information, which is necessary for the progran 
or AV data at this time from the provision information storing means 11 1 by use of the provision informatio. 
selecting means 1 2 (step 1121), and the selected provision information is sent to the multiplexing means 
1 03 (step 11 22) At the same time, the information provider views the program, which is currently on the air 
and selects enabling information, which is necessary for the program or AV data at this time from the 
?E£?° n ' nformation stori "9 means 1 11 by use of the provision information selecting means' 1 12 (step 
1 123), and the selected enabling information is sent to the multiplexing means 103 (step 1124) Thus two 
lands of information are sent to the multiplexing means 1 03. 

[0172] Thus, the frequency of sending provision information may be low by transmitting provision 
information and enabling information separately, and an amount of information to be transmitted at the 
need for providing can be reduced by increasing the frequency of sending enabling information For 
example provision information to be expected in the program is transmitted at only a program starting time 
and enabling mformation may be transmitted in accordance with the content of the program thus providing 
only necessary provision information. P a Proviaing 
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[0173] Next, the following will explain a different point from the first embodiment, with reference to Fig. 10 
that illustrates an example of a flow wherein the broadcast receiving apparatus receives the broadcast 
signal (AV data, provision information, enabling information and the like), the user selects an element 
arbitrarily from the provision information, then reproducing AV data corresponding to the selected element. 

[01 74] In step 1201 of Fig. 10, adding to the separation between AV data and provision information, 
separation of enabling information is carried out. In steps 1202, 1203, determination whether or not 
enabling information is received is performed as well as determination whether or not provision information 
is received. If the enabling information is received, the presentation information storage processing means 
21 1 stores enabling information in the presentation information storing means 212 in the form that remains 
the relationship in time with multiplexed AV data, similar to the provision information. In step 1204, the 
presentation information selecting means 213 selects a portion or the entirety of presentation information 
from the presentation information of the presentation information storing means 212 by use of enabling 
information multiplexed into AV data, which is currently output, as a search key, and the presentation 
information externally outputting means 214 presents the presentation information. Steps 1205, 1206, and 
1 207 are the same as those of the first embodiment. 

[0175] Thus, in the foregoing first embodiment, the broadcast transmitting apparatus transmits all the 
information to be provided to the user when needed, and the broadcast receiving apparatus presents all the 
information received at this time. On the other hand, in the second embodiment, the broadcast transmitting 
apparatus transmits all provision information, which will be necessary for the user, in advance Then the 
broadcast receiving apparatus stores the provision information as presentation information. The broadcast 
transmitting apparatus selects such enabling information that can be used for searching and extracting 
information to be provided from the presentation information stored in the broadcast receiving apparatus 
Then, the broadcast transmitting apparatus transmits the selected information when the need for 
transmitting arises, whereby the broadcast receiving apparatus can present the information intended by the 
information provider, when intended. 

[0176 J F ° r , r « ference sake - "'"king information to AV data, included in each element of provision information 
may be AV data currently on the air, or linking information to AV data that will be broadcast hereafter. 



&lang&Example of service&rang& 



[0177] Suppose that the baseball game is being currently broadcast live. Suppose that the information 
prov.der transmits provision information shown in Figs. 2 and 13 from the broadcast transmitting apparatus 
upon stanng the broadcast of baseball game in advance, and that the broadcast receiving apparatus store<= 
the provision information as presentation information, hf««u» aiuie. 

[01 78] Then, it is assumed that a play-by-play announcer is commenting on the home-run derby Then 
l^ S r ^%£VTr?*™ P rovider ; wr j° has l^tened to this voice, selects enabling information (so'me 
r S ° f n F «" ^ tha ! 18 Wlth 5 h u °™^ « more" in the broadcast transmitting apparatus and 

transmits rt in an ON mode. At this time, the broadcast receiving apparatus receives the enabling 
information and can extract the presentation element of only players with 5 or more homers using the 
number of homers of the player as a searching object from the stored presentation elements. Then only 
the presentation element can be displayed in a menu form. The user selects an arbitrary presentation 

EH? Wl ? fiVe *° mers or more - Afterthat . the broadcast receiving apparatus replays 
stored AV data, whtch the information provider of the broadcast transmitting apparatus has edited and 
which relates to the player corresponding to the presentation element, and user can view the stored AV 
data relating to the selected player with 5 homers or more. At the instant when the commentary on the 
home-run derby is ended, the same enabling information as the previous one is sent in an OFF mode so 
that players with 5 homers or more" is non-displayed on the selection menu screen. Then, the information 
provider transmits the entirety of previous provision information in an OFF mode simultaneously with the 
end of the program. 

[0179] For reference sake, in the broadcast transmitting apparatus, selecting timing of AV data, provision 
information, enabling information may be selected in advance of starting of the program as well as ttie time 
when the program is actually broadcasting. Namely, in a case such as a drama that has already created as 
a program, the broadcast transmitting apparatus may set selecting timing of AV data and provision 
information in advance, since the selecting timing is also determined already. 

£?H?Ln 0re ° V ! r ; the br f dca _st transmitting apparatus may transmit a plurality of provision information tee! 
in advance, and transmit enabling information for searching for provision information itself later, to 
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determine which provision information should be made effective later. 

[0181] As mentioned above, according to the system of this embodiment, provision information is 
transmitted in advance from the broadcast transmitting apparatus then enabling information for controlling 
provision information is muttiplexed into real lime AVdata, and transmitted. This eliminates the need for 
generating information by the broadcast transmitting apparatus, the information being to be provided to the 
user when necessary, and only enabling information as a search key needs to be transmitted so that the 
amount of provider's operations is reduced. In addition, it is passible to reduce the amount of data which is 
multiplexed into AV data and transmitted in real time. 



(Third embodiment) 



[0182] | i n the a broadcasting system based on storage in consumer platforms of the third embodiment, wort 
for adding a tag to image and voice data to be broadcast and work for designating what should be 
broadcast as a reproducing image by use of the tag can be carried out separately. 

[0183] In the first embodiment, the link is directly established between provision information and the AF 
data that is to be broadcast as a reproducing image. However, in the case of directly forming a link to AV 
data from provision information, work for specifying an image to be taken out of AV data to the playback 
image and work for designating the specified image to the provision information must be carried out 
simultaneously, thus making it difficult to carry out these works. 

[0184] The system of this embodiment specifies (cuts) the image to be taken out of AF data into the 
reproducing image by using "cutting information", and designates provision information by use of the tags 
for this cutting information . For this reason, cutting of AVdata and selection of provision information can 
be separated from each other. 

Storing means 11 1 ' prov[sion information selecting means 112, 
separating means 202 presentation information storage processing means 21 1, presentation information 
F gTwHlT 5 I ' 3 d preSentaton informati °n electing means 213, which are different from those of 



&lang&Configuration of broadcast transmitting apparatus&rang& 



&lang&Provision information storing means 111&rang& 



SIS 21 * pr0VIS T '"formation storing means 1 1 1 stores information (hereinafter referred to as 
cuffing information) in which charactenstics of the respective stream data of AV material is described as 
Fin S/ P °Th° n l " forma ? on and enablin 9 information. An example of the cutting information is shown in 

JJ Pin\Ii * £ J '2 forrnat,on fs '"formation that serves as a mark for cuffing AV data, and is describee 
based on ob ects and phenomena such as a person and a landscape and an otject appeared on the 

SX' ? US, t C 'h V ° IC n' Sme "' 3nd J 6 that Pe ° ple can feel " For example ' in a «" ^here A player, B 

£££ h t t 1 ZT* are w d,spla y ed on ° ne «»«• at the same time, AV data of this scene is 

B Scheme catchT^D umptre ^ t0 38 CUffin9 e,emente) of cuttin 9 information including A player 

[0187] Moreover, in order to link AV data and the cutting element to each other, the linking is performed at 
JSfiEX ^Tf^ Name !V- AV data a " d «tt"8 element, which are simultaneity 
multiplexed, are linked. In addition, time information how long the information has been transmitted may be 
nZ^" off e M 9 "formation. Since this time information is correct cutting starting time of the cutting 
^^SSfiXE^ C , Utt ! ng "? formation is determined based on this cutting starting time 

when the cutting information is recorded and replayed by the broadcast receiving apparatus. 

[0188] For reference sake, linking to AV data may be described in the cutting information in advance. 



&lang&Provision information selecting means 1 12&rang& 
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[0189] The provision information selecting means 112 has means that can select two or more arbitrary 
cutting elements simultaneously from the cutting information stored in the provision information storing 
means 1 1 1 , and the information provider can select the cutting element arbitrarily from the cutting 
information by use of this means. If the selection of the cutting elements is performed by the information 
provider, the provision information selecting means 112 combines selected two or more cutting elements 
and sends the resultant to the multiplexing means 1 03 as cutting information. 

S? 19 ?L F ,°! reference sake > cuttin 9 information wherein two or more cutting elements are combined as in 
Fig. 16 (c) is stored in the provision information storing means 1 1 1 in advance and the information provider 
may select the cutting element therefrom. 

[0191] Moreover, instead of selecting the cutting information externally by the information provider it is 
possible to use the configuration wherein the provision information selecting means 112 automatically 
selects the cutting information in response to information of AV data, which will be transmitted hereafter or 
is being transmitted, and in association with the information of the AV data, 

[0192] Furthermore, in a case where the cutting information for cutting AV data keeps the same during a 
fixed range of time period, the same cutting information is transmitted at a fixed cycle, and information 
showing the end of the cutting information is transmitted at a cutting end time. This is the same as the 
transmission form that uses the ON/OFF mode of provision information in the first embodiment 



E1S More ° ver '. the foll ° wing , " ta0 P° ssible . *«* is, when period information showing a fixed period is 
added to cutting information and the cutting information is transmitted, AV data is cut by the same cutting 
imormation fortius period. ° 

[0194] In addition, cutting information, which has already broadcast, may be transmitted simultaneously 
when cutting information relating to the broadcast cutting information is transmitted. Nam ™S 

aTff^ 



&lang&Configuration of broadcast receiving apparatus&rang& 



&lang&Separating means 202&rang& 



AV 9 r2tI h n r S , eparatin ? me T S 2 ? 2 se P arates the broadcast signal received by the receiving means 201 into 
AV data, proven information for providing AV data, and cutting information for cutting AV data 

&lang&Presentation information storage processing means 211&rang& 

[0196] The presentation information storage processing means 21 1 receives provision information for 
KS%5 V f ^ ^ n9 - information for cuttin S AV data, which have been ^iS^SlJinrtliK 
means 202, and stores them into the presentation information storing means 212. separate 

w^!^ °f St0ri 1F CUttin 2 information t0 presentation information storing means 212, if AV 
data identification information such as a channel a time period associated with AV data, is described in the 
cutting information, the information is stored thereto directly. Or, the cutting information is converted to 

£ o ma ion KSSt * th f k broadcast receivin 9 originally, andKSSSd 

information is stored thereto. Moreover, there is a case wherein only identification information such as a 
name ,s described in the cutting information and no information mLuM^iFSSX^Sto^ 
therein as in he case wherein enabling information is stored in the second embodiment In this case the 
EST! 011 ,n orma 5 on JS* means 21 2 stores the cutting information togethe wrthAV data 
identification information (AV to be presented) and time information (cutting time period) to keep the 

Sm fKKir ^ mUHipleXed simu[tane ° u ^ wit " t"e cutting inforrnS see Hg 17). 
S milady to the case n which the presentation information storage processing means 21 stores 
presentation information m the first embodiment, the cutting period of cutting information s stored while 

i ? « ?' A V data multiplexed simultaneously with the cut information can be replayed The 
rSn! f (cutting ID, cutting name, AVto be presented, and the like) of Fig. 17 depend on the AV 
data managing form, so that they are for the purpose of showing the example. These items may be 
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configured by any combination. 



&lang&Presentation information selecting means 21 3&rang& 



*[0198] The presentation information selecting means 213 selects presentation information from the 
presentation information storing means 12, the presentation information having been multiplexed 
simultaneously with AV data currently outputting and been transmitted, and the presentation information 
externally outputting means 214 externally outputs in the menu form. 

[0199] Moreover, the presentation information selecting means 213 has means that can externally select 
the presentation information stored in the presentation information storing means 212. Therefore, the user 
can select an arbitrary presentation element from the presentation information of menu form, which has 
been externally output. Then, if the user selects the presentation element, the presentation information 
selecting means 213 extracts cutting information added to the presentation element or the cutting element 
The presentation information selecting means 213 sends linking information to AV data, which has been 
added to the cutting information or the cutting elements and which has been stored so far, toward the AV 
data selecting means 205. This allows the AV data selecting means 205 to select AV data from the AV date 
stonng means 204 and to output the designated AV data. 

[0200] Thus, the broadcast receiving apparatus can associate presentation information and AV data with 
each other by use of cutting information as an intermediation. 

[0201] For reference sake, as a method for selecting the presentation information stored in the presentation 
information stonng means 212 a means can be configured so that the element of presentation information 
is automatically selected instead of the external input. In this case, the selection method such as a selects 
order is described m the presentation information itself, and once an element of the presentation 
information is selected, the presentation element is automatically selected in order of the description 
sequentially thereafter. K 

H ?nfeT™Sn e t. AvTi SinC ? broadM * ^mitting apparatus can use the cuffing Information as 
linking information to AV data, only the cutting information needs to be mapped to the provision information 
without any attention to be paid to the configuration of the program. In addition, since the cutting of AV data 
and the provision timing of AV data are separated, the transmission operation can be simplified. Moreover 
Zl"Zl br °l a ? : eceiv| ng apparatus, the cutting information intermediates between the presentation 
nformation and AV data, so that this eliminates the need for connecting information of AV stream data to 
™»in eSe J r ,nform , at,on ' consequently making it possible to customize data easily by adding only the 
cutting information to the presentation information. 



&Iang&Example of service&rang& 



[0203] Supposing that the broadcasting of baseball game is relayed live, A player's first turn at bat is 

asSr a Jpd ?n 5? ^f.f " tUm * bat '! a ' m ° st Started - Moreover ' jt is assumed that information 

as illustrated in Fig. 16 is stored in the provision information storing means 111 of the broadcast 
transmitting apparatus. At this time, one information provider selects cutting elements such as 
broadcasting of baseball game", "G team", "A player", "at bar, "2", and the like from the cutting 
information, combines them, and continues to transmit the combined cutting elements as cutting 
information in an ON state while the scene of A player's second turn at bat is broadcasting. Whereby AV 
data corresponding to the scene of A player's second turn at bat is managed as AV data Ling cutting 
elements such as broadcasting of basebad game", "G team", "A player", "at bat", "2", and the Hke in the 
broadcast receiving apparatus. Moreover, another information provider transmits provision information 
relating to A player" combined with this cuffing information without concern for editing of AV data 
Whereby, the user of broadcast receiving apparatus can obtain information of "A player" when "A player" is 

LmvkL^fnr^ 6 " A P ' ayer iS a = ba V he S6 u 0nd fime ' the broadcast transmitting apparatus transmits 
provision information as shown in Fig. 2 simultaneously with the transmission of cutting data of AV data In 
Irf^r 3 d n ^ e rece,vin g. a PP arat ^, me user can view the scene of A player's at bat so far when information 
SKJi; * CT a " * V2T U f °T £ additi0n ' by tn,n « m « ft W enabIi »g information that makes only 
he nformation of A p^yer effective, only the information of "A player" and afterward is presented, and the 
user can select only the information of "A player". For reference sake, when "A player" finished his tarn™ 
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bat", cutting informatton OFF is transmitted. 

[0205] Moreover, the user shoots AV data relating to A player voluntarily and adds cutting information of "A 
player" to create the AV data, so that the user can select AV data of A player shot by the user voluntarily 
when A player is at bat as heretofore. 

[0206] As mentioned above, the broadcast transmitting apparatus can carry out work for cutting AV data 
and work for selecting provision information separately, so that the work of information provider can be 
shared and information can be provided efficiently. Furthermore, in the broadcast receiving apparatus, the 
user can easily carry out edition agreeable to the user's taste in order to clarify the relationship between the 
presentation information and the cutting information. Moreover, in the broadcasting system, the user can 
obtain information intended by the information provider, when intended. 



(Fourth embodiment) 



[0207] In the a broadcasting system based on storage in consumer platforms of the fourth embodiment, the 
display form of the image that is presented based on provision information is changed to a case of real time 
viewing in the playback viewing after storage. 

[0208] In this system, the following will explain the provision information storing means 11 1 of Fig 1 which 
is different from that of the first embodiment. ' 



&lang&Provision information storing means 1 1 1 &rang& 



[0209] Provision information stored in the provision information storing means 111 of the broadcast 
transmitting apparatus has information for reproducing AV data broadcast so far and the attribute of the 
information. Then, playback control after the provision information is stored is described in the attribute. 

[0210] For example, the provision information should be displayed to keep the relationship with AV data 
broadcast at the same time in real time broadcasting ("real time" in Fig. 18). Or, although the provision 
information is associated with AV data broadcast at the same time in real time broadcasting after the 
storage, such a relationship should be ignored and a different standard is presented, and the like. 

E 11 R ^Sl^.o- di ?r nt ^ ndard ' there are exam P |es such as that the provision information is always 
disp ayed (ON AIR of Fig. 1 8), or the provision information, which has been once viewed, is always 
d nrSc y «li * !£)■ ° f r a time period is designated and the provision information is made effective 
?AFTEF^of Hg ,0d 8) d°th l°k 9 } ' *' information is made effective aftert ^ storage 



&lang&Example of service and that of operation&rang& 



[021 2] Suppose that there is a program from 19:00 to 21 :00 and that provision information that is an 
intermediate result is broadcast at the time of 20:00. Atthis time, if the program is replayed after the end o 
this program the provision information, "intermediate result" can normally obtained at the lime only after a 
lapse of one hour since the start of the program. 

[0213] Assumed that the effective period after the storage of the provision information, that is, "entirety of 
program or effective from the start of program to the end of program after storage" ("ON AIR" of Fia 1 81 i< 
descnbed in this provision information. With this assumption, however, the presentation information of * 
immediate result" that is to be presented for the first time when it is 20:00 in the real time broadcasting wil 
be presented from the start to the end of the program when this program is replayed after the end of 
Broadcasting. 

[0214] Moreover, another example will be explained. Suppose a case in which the user wishes to view the 

«cm 6 A^ tS fifSt tUr " at b . a . t , at the time When A P Ja V er is at bat the tt'" 1 time - ^ this time, it is 
assumed that the user rewinds AV data so far and views the scene of A player's first turn at bat In this 
case, there are two cases; one in which presentation elements of A player's "second at bat" and "third at 
bat may be displayed on the screen, and the other case in which they may not be displayed thereon The 
former case means that the presentation elements corresponding to "second at bat" and 'third at bat" whict 
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have been already replayed and viewed one time, are displayed if an attribute of "provision information to 
AV data that is once viewed is made effective" ("VIEW" of Fig. 18) is added as an attribute of the provision 
information. Moreover, the latter case means that the presentation elements corresponding to "second at 
baf and "third at bat" are not displayed at the time when the first turn at bat is replayed if an attribute of 
'display to keep the relationship with AV data broadcast at the same time in the real time 
broadcasting" fREAL TIME" of Fig. 18). 

[0215] Furthermore, there is an example wherein presentation information that is made effective only when 
the stored program is replayed CAFTER" of Fig. 18). There is a case wherein a program including 
commercials (CMs) is replayed as it was actually broadcast. However, when the program and commercials 
are stored and managed separately and replayed, it is possible to change the way to replay the program 
after the storage by use of the provision information such that commercials are placed at random {in view o 
time, geometry, and the like) instead of reproducing the program as if it was actually broadcast. Namely, 
the following service can be considered. More specifically, provision information of "CMs are replayed at 
one time" is made effective when the playback of stored program is started. Then, if the user selects it CM; 
to be broadcast in the program are first replayed at one time, and thereafter the main part of the program is 
replayed. 

[0216] For reference sake, the above can be realized by transmitting enabling information that makes 
provision information of "CMs are replayed at one time" effective using enabling information of the second 
embodiment after the end of the corresponding program. 

[021 7] As described above, the description of playback control after the storage as an attribute of provision 
information makes it possible to provide AV data once stored and presentation information at timing other 
than provide timing of the information provider transmitted in realtime. Moreover, the program is stored so 
that the user can freely view previous information of the program by the stored presentation information! 

(Fifth embodiment) 

[0218] In the a broadcasting system based on storage in consumer platforms of the fifth embodiment, the 
range of information, which is presented with presentation information, is limited by the user's intension and 
viewing history. 

[0219] In the system of the fifth embodiment, the presentation information selecting means 213 of Fia 1 
which is different from that of the first embodiment, will be explained. * ■>> or rig. , 

&lang&Presentation information selecting means 213&rang& 

[0220] The presentation information selecting means 213 has means that can select the provision 
information stored in the presentation information storing means 212 externally or make it effective 
Namely the user can make a rule for selecting presentation information or making it effective. Moreover 
the configuration wherein the previous rule is automatically created or changed based on the user's view 
history may be used. 

[S?.H.n Here : SOme ! Xa TJfl°i the , rule f0r selection are given - For sample, Provision information 

J! m ?n£ ♦* ? 1*1°^ frOI 2 k - 6y W ° rds inpUt by the user or from ke y words as sh °wn in Figs. 2 and 

1 4 is presented on a higher priority basis, or inversely is, not presented on a higher priority basis Or 

2 a °S 1 1? for „ sel ? c 1 °" ca " be ™ de ^ch that a name of program, which is often viewed, is registerec 
as a key word, and only information relating thereto is presented. 

[0222] For reference sake, instead of changing the rule for selection in the presentation information 
selecting means 21 3, means may be provided for editing presentation information itself stored in the 
presentation information storing means 212, whereby presentation information may be edited on the 
broadcast receiving apparatus side. 

[0223] Moreover, a rule may be provided such that presentation information is stored in the presentation 
information stonng means 212 in the presentation information storage processing means 211, thus sifting 
presentation information at the storing time. 



&lang&Example of service due to user's input&rang& 
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[0224] First, an example is given of a case in which the rule for selection set by the user is reflected upon 
the selection of presentation information by the presentation information selecting means 213. 

[0225] It is assumed that the baseball game is broadcast live. Moreover, supposed that a scene wherein A 
player is at bat is broadcast similarly to the foregoing embodiment. At this time, the information provider 
starts to provision information of A player of G team, S pitcher of T team, H catcher thereof, as provision 
information. However, since the user has a great interest in team T, the user needs only the information of 
S pitcher and H catcher than that of A player at this time. Then, the user sets a rule to give a higher priority 
to team T as a rule for selection of presentation information. As a result, only the presentation elements of 
S pitcher of team T and H catcher thereof are displayed on the screen even if A player of team G is at bat 
Thus, information of T team, which is necessary for the user, can be obtained on a higher priority from 
information that is provided by the information provider. 

!? 226] F *u r refer f nce sake, the user's taste may be extracted from the user's inputs so far or from the view 
history, thus setting the rule for selection automatically such that the resultant is reflected thereon. 



&lang&Example of service using view history&rang& 



KH^nTl' an e f mP L e iS f P! ained of a M8e wherein the ^ew history of user is reflected on the selectior 
of presentation information by the presentation information selecting means 21 3. 

H" tTTf 6 th3t the br ° adcastin 9 of th e baseball game is broadcast live. Moreover, suppose that 

hlEn ?h ^ T™} ^ ^ be9illnin9 ^ * B M n0t VleW CM broadc ^t in the 

beginning. Then, the information provider transmits provision information of "automatic playback of 
unviewed CM just when the defensive team is changed. The broadcast receiving appaSsLt has 
unJS STf ' S,0n In ormati ° n mak6S this provision infof ™tion ineffective if Lie is no CM that is 
unviewed wrth reference to the users' view history. The broadcast receiving apparatus makes this provision 
information for presenting CM effective if there is a CM that is unviewed, and starts tc ^reTlarthfcMTa is 

TtlT^TT't ,,y - Namely ' the information provider can P rovide the ™™e!lHa 7^£Z%L*%£ 

of the program to the user, using a vacant time in the content of the program. 

S«S, F ° r reference sake > the above can be applied to the reproducing of a specific AV data when 
reproducing of the program recorded is performed afterthe end of the broadcasting of the basebaS aame 
h 0the , r r rdS ' pr ° V,Sion informat ien of "automatic playback of unviewed CM" is sen to some ^scenes in 

w^reproducfng } " ' " " P ° SS ' b,e * C ° ntr °' CM ™™ 9 based on the "eer's'view record even 

[0230] Moreover it is assumed that the program commercial of this program is broadcast before the 

V P Zn a m nrnn r r dCaSt ^T^" tranSm «» P™*™ ^S^SS^Sr prize H 

SSSnH commercial" upon the end of the program. The broadcast receiving appaVa4 that has 
commSc 5 h a L 0 nnth n .l nf0rmat H n T h k6S , thS P resentation informa «en ineffective when the program 
Sina SJZli S2L fr d ' ^ re J eren f t0 the user's view history. Moreover, the broadcast 
^SPjS^SS onl tor n^nr^h" ,nft ™«°" affective when *• program commercial has been 

d^oM 

EIIoh^ 0 " 6 ^ abov .e. P™vision information sent from the broadcast transmitting apparatus is 
converted to presentation information by the broadcast receiving apparatus, and the broadcast receivina 
apparatus can fix enabling information that makes only the limited presentation iZmSS^S^mB 
makes ,t poss.ble to reflect the information provider's intension and to present availaWe nformatfon *fo!the 
infn L M ° re0Ver ' ! V6n ? P re ? entation information is stored in the broadcast receM^JS^tS 
S ™ P ro .y ,der t of K the broadcast transmitting apparatus transmits enabling information or Retina 
Furen^oreme^ 

S e Tr« Jf Q « use r of the broadcast receiving apparatus can fix enabling information that makes only th< 
limited presentation information effective. This makes it possible to reflect the information provider's 
intension and to present available information for the user "'mauon proviaers 
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(Sixth embodiment) 

[0232] in the a broadcasting system based on storage in consumer platforms of the sixth embodiment, if 
information designated by provision information is not stored in the broadcast receiving apparatus, the 
broadcast receiving apparatus obtains it from the database storing the corresponding information therein 
and displays it. 

[0233] Fig. 19 shows apparatus to compose the broadcasting system of the sixth embodiment, namely a 
broadcast transmitting apparatus 1 00, a broadcast receiving apparatus 200, and an AV data providing 
apparatus 300 for storing all the AV data. The broadcast transmitting apparatus 1 00 is the same as that of 
Fig. 1 , and the broadcast receiving apparatus 200 is the same as the broadcast receiving apparatus of Fig 
1 , but including an AV information transmitting means 221 . The AV data providing apparatus 300 stores all 
data received from the broadcast transmitting apparatus 100, and when the provision of data is required 
from the broadcast receiving apparatus 200, the AV data providing apparatus 300 transmits the 
corresponding data to the broadcast receiving apparatus 200. 

[0234] These broadcast receiving apparatus and AV data providing apparatus will be specifically explained. 



Alang&Broadcast receiving apparatus&rang& 

S5? 5 Jw If 1, ' n the broadcast receiving apparatus of Fig. 19, the receiving means 201 , separating means 
202, AV data storage processing means 203, presentation information storage processing means 21 1 AV 
data setecting means 205, which are different from those of the first embodiment, and the AV information 
transmitting means 221 , which is newly added, will be explained. 

Alang&Receiving means 201&rang& 

[0236] The receiving means 201 can receive AV data and presentation information through a data 
transmission line B 403 simultaneously through a broadcast transmission wave 401 . 

[0237] For reference sake the broadcast transmission wave 401 and data transmission line B403 may be 
one and the same transmission line. 1 

&lang&Separating means 202, AV data storage processing means 203, presentation information storage 
processing means 21 1 &rang& 

[0238] Since the receiving means 201 receives AV data and presentation information through the 
transmission Imes of two routes mentioned above, data from the two routes are sent to the separating 
means 202, the AV data storage processing means 203, and the presentation information storage 
processing means 21 1 simultaneously. Each means processes data in the same manner, and data from 

™lt% r ?? eS *h re thS AV data St0ring means 204 and in the Presentation information storing 

means 21 2 in the same manner. 

&lang&AV data selecting means 205&rang& 

[0239] The AV data selecting means 205 automatically generates information (hereinafter referred to as AV 
information) for identifying AV data of a portion to be replayed when AV data, which is currently to be 
replayed, is not presented in the AV data storing means 204, and sends the generated information to the 
AV information transmitting means 221 . Here, any information may be used as AV information if it is 
identification information that can determine a portion or the entirety of the program uniquely. For example, 
! J£ onH £ r? broad ^ astin 9. broadcasting station, name of program, program start time, program end 

[0240] AV information is automatically generated herein, and any trigger for generating AV information may 
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be used. Therefore, generation of AV information may be performed manually. 
&lang&AV information transmitting means 221 &rang& 

[0241] AV information transmitting means 221 receives AV information from the AV data selecting means 
205, and transmits it through a data transmission line A402. For the data transmission line A402 Internet 
using a telephone line, and a fixed-line cable for CATV, and the like can be employed. At this time, 
identification information for identifying the broadcast receiving apparatus itself may be transmitted 
simultaneously. This is used in a case wherein the transmitting side specifies the receiving side and 
transmits AV data thereto. Therefore, there is no need for information to identify the receiving apparatus in 
a case where a broadcasting wave employed can transmit designated AV data to the receiving apparatus 
required, even if the receiving side is not specified. 

&lang&AV data providing apparatus 300&rang& 

[0242] Next, the configuration of AV data providing apparatus 300 of Fig. 19 will be explained. 
&lang&Data receiving means 301&rang& 

[0243] The data receiving means 301 receives a broadcast signal to be broadcast to the broadcast 

^ ve h 401 ^ e broadcast signal in which AV data and provision information are multiplexed is 
lTt 1 15 ^^transmission wave 401 from the transmitting means 104 of the broadcast 
transmrthng apparatus 100. For reference sake, there is a case in which only AV data is used as a 
Dro3GC3St signs!. 

&Jang&Data storage processing means 302&rang& 

£2Sn°n a S 8t ° ra ?; , P K Ce f SinQ meanS 302 manages the broadcast si 9 nal that is receive d by the data 
nS3 f " S - 3 ? 1 ' by , St ° n « 9 rt m the data storing means 303 " ln the case w here AV data and additional 
mformafton (provision ^formation, enabling information, cutting information and the like) accompanying , wrt 

«n f SI mUlt ' pl f e l aS 3 br ° adcast signal ' there are *« storin 9 m^hods; one is that they are 
separated from each other, stored and managed, and the other is that the broadcast signal is directly store. 
ES^EXS" a fi Str f h am , ? e St ° rage mana 9 em ent may be performed by either method. At th s time 
identifiers that can fix the data uniquely are assigned simultaneously to AV data and to additional 

nnSITn ?h aCC T P r ny | ng ^ AV data ' then tne resultant are stored This makes it possible to extract a 
portion or the entirety of a certain specific program. w»ra« a 

&lang&Data storing means 303&rang& 

SfltaJ'S d3ta St ° ring meanS 303 iS 3 St0rage medium t* 13 * st °ras AV data and additional information fron 
K^ISJESI Pr0ce ™ n * means 302 - memor V. HDD, PD, MD, MO, DVD-ROM, DVD-RAM, DAT D 
VHS, and the like can be used as a storage medium. 

&lang&AV information receiving means 311&rang& 

l°2;; V formation receiving means 31 1 receives AV information that uniquely identifies AV data 
IT if t ♦ fran L m ' ss , lon hne A402 . and s^ds it to the data selecting means 304. This AV information is 

in * n ? mrttod form the fore g° in 9 A V information transmitting means 221 , and identificaZ 
Ssmlttng appa a a n tu S s PeCl ^ ' P " 0r ^ ° f ^ pr ° gram broadcast 50 far from the broadcast 



&lang&Data selecting means 304&rang& 
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[0247] The data selecting means 304 extracts a portion or the entirety of the program, which has been 
broadcast so far and stored in the data storing means 303, based on AV information from the AV 
information receiving means 31 1 , and transmits them to the data transmitting means 305. Moreover, if data 
stored in the data storing means 303 is managed separately as AV data and additional information ' 
accompanying with AV data, they are multiplexed and sent to the data transmitting means 305. 



&lang&Data transmitting means 305&rang& 



[0248] The data transmitting means 305 transmits data received from the data selecting means 304 to the 
broadcast receiving apparatus 200. In transmitting the data, the broadcast wave used between the 
broadcast transmitting apparatus 100 and the broadcast receiving apparatus 200 is utilized, also Internet 
using a telephone line, and a fixed-line cable for CATV, and the like can be employed. 

[0249] In the case where a data transmission line B403 transmits data to each receiving apparatus, for 
example, on the Internet using the telephone line, it also receives information that can identity the receiving 
apparatus, which has transmitted AV information, and performs the transmission thereto, differently from 
tiie case where the data transmission line B403 transmits data to many receiving apparatuses as in the 
broadcast transmission wave 401. 

[0250] Moreover, in the case where the data transmission line B403 transmits data to many receiving 
apparatuses as in the broadcast transmission wave 401, the following form may be used. More specifically 
there is provided in means for scheduling when and where the data is transmitted, and trigger information ' 
which shows a transmitting schedule, is transmitted to the broadcast receiving apparatus and the 
broadcast receiving apparatus that has received the trigger information fetches required AV data and 
additional information accompanying with AV data again. 



&lang&Operation flow&rang& 



SS ? ! U eX J: „ reference to F| 9' 20 ' the followin g wil[ e *P^n a flow wherein the AV data selecting means 
205 of the broadcast receiving apparatus generates necessary AV information, the AV information 
transmitting means 221 transmits the AV information, so that the corresponding AV data is received and 
replayed. Herein, the following will be explained on the precondition that AV data and provision information 
so far are not stored at all. 

[0252] First, an instruction to replay AV data is generated (step 121 1). This instruction is directly performed 
by the user or it is generated based on the presentation information. Then, the AV data selecting means 
205 searches whether or not designated AV data exists in the AV data storing means 204 (step 1212) If 
AV data exists the AV data is extracted (step 1216), and replayed (step 1217). On the other hand, if no AV 
data exists, AV information for identifying designated AV data is created, and the AV information 
transmitting means 221 transmits it (step 1213). As a result, the AVdata providing apparatus 300 transmits 
the corresponding AV data through the data transmission line B402 (Fig. 21 , to be explained later) Then 
the AV data storage processing means 203 is on standby until the receiving means 201 receives the 
corresponding AV data from the data transmission line B402, and if the corresponding AV data is received 
f^Vll * 1 n L e AV data stora 9 e Processing means 203 stores it to the AV data storing means 204 (step 
Then ' the AV data selectin 9 means 205 extracts the AV data, which is originally designated (step 
1216), and replayed (step 1217). 

[0253] For reference sake, the apparatus for receiving data is not necessarily mounted on the previous 
broadcast receiving apparatus, and another data receiving apparatus may be placed. 

[0254] Next, with reference to Fig. 21 , the following will explain a flow wherein the AV data providing, 
apparatus 300 foregoing AV data transmitted by the AV information transmitting means 221 of the 
broadcast receiving apparatus, and transmits a portion or the entirety of the program broadcast so far. 

[0255] First, the AV information receiving means 311 receives AV information transmitted from the 
broadcast receiving apparatus 200 (step 1301). Then, the data selecting means 304 that has received the 
AV information searches whether or not the corresponding AV data or provision information exists in the 
data storing means 303 (step 1302). If no corresponding data exists, the notification that no data exists is 
transmitted (steps 1304, 1305). If the corresponding data exists, the AV data and additional information 
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accompanying with the AV data or either one of them is extracted from the data storing means 303 (step 
1303), and converted to a format of the data transmission line B403 and transmitted (step 1305). 

[0256] For reference sake, as the transmission line, the broadcast transmission line 401 , the data 
transmission line A402, and the data transmission line B403 may be the same as each other, or different 
from each other, or combinations of these may be the same as each other. 



&lang&Example of service&rang& 



[0257] It is assumed that the broadcasting of baseball game is broadcast live. Then, supposed that the 
broadcast receiving apparatus takes a form in which the storage of the program starts after the user starts 
to view the program, and that the content of the broadcasting of baseball game so far is not stored at all. 
However, the AV data providing apparatus stores all of the contents of the program so far. Then, when the 
scene wherein A player is just at bat is broadcast, the information provider starts to transmit provision 
information of A player linked to AV data so far in ON mode. When A player is at bat, the user replays the 
scenes of A player's at bat broadcast so far based on the provision information received by the broadcast 
receiving apparatus. This allows the user to receive service in which the user can view information of A 
player. 

[0258] However, in this case, all the scenes of A player's at bat so far are not stored. Here, information of a 
the scenes of A player's at bat so far is transmitted to the AV data providing apparatus 300 as AV 
information. For example, since linking information to AV data is added to the presentation information the 
!? bl ™!!? n ls transm,tted direct| y (AV data linking information of the presentation element configuration of 
Fig. 6). The AV data providing apparatus 300 has the storage medium with a large capacity where all 
programs broadcast so far are stored, and the broadcast receiving apparatus receives only the 
corresponding AVdata automatically from this AV data providing apparatus. This allows the broadcast 
receiving apparatus to replay all the scenes of A player's at bat therefore the user can view all the scenes o 
A player's at bat so far. 

[0259] For reference sake, the AV data providing apparatus may be used as an internal configuration of an' 
one of the broadcast transmitting apparatus and the broadcast receiving apparatus, and also be one or 
more AV data prodding apparatuses provided as another apparatus. For example, for a plurality of 
broadcast transmission waves 401 including local stations, the AV data providing apparatus may receive 
and manage a plurality of broadcast transmission waves and AV data of a plurality of local stations In 
addition, if there is a broadcast receiving apparatus having a large storage medium, the broadcast receivint 
apparatus possesses the function of the AV data providing apparatus. This allows the broadcast receiving 
apparatus having a small storage medium to obtain only necessary AV data from the broadcast receivina 
apparatus having a large storage medium. receiving 

[0260] Thus, there are cases wherein AV data to be replayed does not exist in the broadcast receiving 
apparatus, when the broadcast receiving apparatus itself has such a mechanism that can store the entirety 
of the program or the storage medium is not so large. Fore these cases, if the AVdata providing apparatus 
that stores the entirety of the program is configured in the broadcasting system, the information provider of 
the broadcast transmitting apparatus can provide the service without concern for the function of the 
broadcast receiving apparatus. In addition, the AV data providing apparatus is separated from the 
broadcast transmitting apparatus, whereby making it possible to manage AV data in various broadcast 
transmitting apparatuses and to supply the AV data to the broadcast receiving apparatus. Moreover the 
user can automatically obtain necessary data as required, and this allows the user to receive the service 
provided by the information provider similar to the broadcast receiving apparatus having the storage 
medium with a large capacity. 



[Effect of invention] 



[0261] As is obvious from the above explanation, according to the broadcast transmitting apparatus of the 
present invention, the information provider can provide the provision information, which changes with 
providing time and is linked to AV data which has been intentionally edited by the information provider to 
the user as information relating to AV data, which is currently broadcasting. Moreover the broadcast ' 
transmitting side can control information to be desirably provided in accordance with to the content of the 
program, which is currently broadcasting. 

[0262] Furthermore, the broadcast receiving apparatus presents presentation information linked to AV data 
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as information to be presented simultaneously with AV data multiplexed at the same time, and the user 
arbitrarily selects the element of the presentation information. This allows the user to view a portion or the 
entirety of stored AV data linked to the element. 

[0263] Moreover, even when the user replays the stored AV data, the user can catch up with the program 
which is currently broadcasting, because the AV data, which is currently broadcasting, is also stored at the 
same time. 

[0264] Furthermore, the a broadcasting system based on storage in consumer platforms of the present 
invention presents presentation information linked to AV data, as information to be presented 
simultaneously with AV data multiplexed at the same time, and the user arbitrarily selects the element of 
the presentation information. This allows the user to view a portion or the entirety of stored AV data linked 
to the element. 

[0265] Moreover, even when the user replays the stored AV data, the user can catch up with the program 
which is currently broadcasting, because the AV data, which is currently broadcasting, is also stored at the 
same time. 

[0266] Namely, the user, who views the program from halfway, can view the program from the beginning 
efficiently, also can view the past programs effectively. 

[0267] Moreover, the user can receive the service wherein the broadcasting program so far is abbreviated 
and viewed based on the intended content when the broadcast transmitting side intends. 

[0268] Further, in the system for transmitting enabling information from the broadcast transmitting 
apparatus, a portion or the entirety of the provision information is transmitted from the broadcast 
transmitting apparatus in advance. Then, at the time of providing information relating to the content of the 
program, which is currently broadcasting, only the enabling information for searching and extracting the 
elements of the provision information that is made effective from the provision information linked to AV data 
broadcast so far may be transmitted. This reduces the number of operator's operations for providing 
information In the broadcast receiving apparatus, the user can obtain only the provision information that is 
made effective by the information provider at this time, and can view a portion or the entirety of AV data 
stored so far based on the information. In addition, it is possible to reduce the amount of data which is 
multiplexed into AV data and which is transmitted in real time. 

[0269] According to the system for cutting the broadcasting program by use of cutting information the 
broadcast transmitting apparatus can carry out work for cutting AV data and work for selecting provision 
information separately, so that the work of information provider can be shared and information can be 

m e ? C ^ ntly - F , u * e : m . ore ' J 1 the breast receiving apparatus, the user can easily carry out editing 
agreeable to the users taste in order to clarify the relationship between the presentation information and 
the cutting information. Moreover, in the broadcasting system, the user can obtain information intended by 
the information provider, when intended. y 

[0270] Furthermore, in the system wherein the presenting method after storing the provision information is 
descnbed as an attnbute of provision information, it is possible to provide AV data and presentation 
information once stored even at timing other than providing timing by the information provider as in real 
time. Moreover, the program is stored, so that the user can freely view previous information of the program 
by using the stored presentation information. piuyram 

[0271] Moreover according to i the broadcast receiving apparatus, in one that makes it possible to change 
the rule for selection of the AV data selecting means, provision information sent from the broadcast 
transmitting apparatus is converted to presentation information by the broadcast receiving apparatus and 
the broadcast receiving apparatus can designate enabling information that makes only the limited ' 
presentation information effective. This makes it possible to reflect the information provider's intension and 
to present enabling information for the user. Moreover, even if presentation information is stored in the 
broadcast receiving apparatus, the information provider of the broadcast transmitting apparatus side 
transmits enabling information for extracting information to be currently provided, whereby narrowing the 
present range of presentation information. Furthermore, the user of the broadcast receiving apparatus can 
designate enabling information that makes only the limited presentation information effective This makes it 
possible to reflect the information provider's intension and to present enabling information for the user. 

[0272] In the system having the AV data providing apparatus, even if there is used the broadcast receivinq 
apparatus, which does not store the entirety of the program so far or which can not store it, AV data so far 
can be replayed without fail when it is intended to be replayed by use of the AV data providing apparatus 
which manages a portion or the entirety of AV data and which transmits it as required. In addition the AV 
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data providing apparatus is separated from the broadcast transmitting apparatus, whereby making it 
possible to manage AV data of various broadcast transmitting apparatuses and to supply the AV data to th« 
broadcast receiving apparatus. Moreover, the user can automatically obtain necessary data as required, 
and this allows the user to receive the seivice provided by the information provider similar to the broadcast 
receiving apparatus having the storage medium with a large capacity. 

[0273J The invention has been described in the above in connection with preferred embodiments, and it will 
be understood that various modifications and variations may be made without departing from the scope of 
the present invention set forth in attached claims. 
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